-- Logs begin at Wed 2022-08-24 04:50:40 UTC, end at Wed 2022-08-24 06:13:19 UTC. -- Aug 24 05:35:21.428889 dv-cinder-854267-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 05:35:21.438498 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 05:35:21.441224 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 05:35:21 2022] *** Aug 24 05:35:21.441224 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 05:35:21.441224 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 05:35:21.441224 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: nodename: dv-cinder-854267-1-iscsi Aug 24 05:35:21.441224 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: machine: x86_64 Aug 24 05:35:21.441224 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: clock source: unix Aug 24 05:35:21.441224 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: pcre jit disabled Aug 24 05:35:21.441224 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: detected number of CPU cores: 4 Aug 24 05:35:21.441224 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: current working directory: / Aug 24 05:35:21.441224 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: detected binary path: /usr/bin/uwsgi-core Aug 24 05:35:21.441948 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: your processes number limit is 47680 Aug 24 05:35:21.441948 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: your memory page size is 4096 bytes Aug 24 05:35:21.441948 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: detected max file descriptor number: 2048 Aug 24 05:35:21.441948 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: lock engine: pthread robust mutexes Aug 24 05:35:21.441948 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: thunder lock: enabled Aug 24 05:35:21.441948 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 05:35:21.441948 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 05:35:21.481895 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: Python main interpreter initialized at 0x556e2e1ae9c0 Aug 24 05:35:21.481895 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: python threads support enabled Aug 24 05:35:21.481895 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: your server socket listen backlog is limited to 100 connections Aug 24 05:35:21.481895 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: your mercy for graceful operations on workers is 90 seconds Aug 24 05:35:21.482309 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 05:35:21.482309 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: *** Operational MODE: preforking *** Aug 24 05:35:21.482977 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: *** uWSGI is running in multiple interpreter mode *** Aug 24 05:35:21.482977 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: spawned uWSGI master process (pid: 112659) Aug 24 05:35:21.482950 dv-cinder-854267-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 05:35:21.483523 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: spawned uWSGI worker 1 (pid: 112660, cores: 1) Aug 24 05:35:21.483822 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: spawned uWSGI worker 2 (pid: 112661, cores: 1) Aug 24 05:35:21.483972 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 05:35:22.159129 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 05:35:22.210521 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 05:35:23.259070 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:35:23.259070 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: from cryptography.utils import int_from_bytes Aug 24 05:35:23.259714 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:35:23.259714 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: from cryptography.utils import int_from_bytes Aug 24 05:35:23.326684 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:35:23.326684 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: from cryptography.utils import int_from_bytes Aug 24 05:35:23.327265 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:35:23.327265 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: from cryptography.utils import int_from_bytes Aug 24 05:35:25.781669 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:35:25.782381 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:35:25.782500 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:35:25.782803 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:35:25.783058 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:35:25.783449 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.783776 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.784097 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.784446 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.784786 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.785099 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.785422 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.785751 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.786853 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.787120 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.787444 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.787954 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854267-1-iscsi {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.788284 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.788619 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.788937 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.789259 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.789568 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.789891 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.790198 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.790697 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.791130 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.791441 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.791754 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.792097 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.792466 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.792771 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.793095 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.793405 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.793733 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.795048 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.795456 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854267-1-iscsi {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.795779 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.796098 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.796442 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.796870 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.797184 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.797497 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.797829 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.798152 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.798468 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.798795 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.799113 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:35:25.799531 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.799624 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:35:25.799704 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.799787 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.799910 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:35:25.800033 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.800276 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:35:25.800369 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.800566 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:35:25.800675 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.800957 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.801055 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.801293 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.801399 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.801598 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.801682 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.801849 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.801964 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.802746 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.803301 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.803522 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.803618 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.803854 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.803953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.804190 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.804287 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.804462 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.804565 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.804792 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.804896 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.805115 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.805202 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.805427 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.805523 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.805739 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.805832 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854267-1-iscsi {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.806049 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.806148 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.806359 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.806445 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.806669 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.806756 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.806978 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.807157 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.807287 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.807374 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.807597 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.807683 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.807919 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.808015 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.808241 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.808455 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.808574 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.808782 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.808878 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.809098 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.809183 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.809417 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.809584 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.809762 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.809860 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.810083 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.810176 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.810399 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.810484 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.810727 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.810825 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.811049 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.811177 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.811369 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.811502 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.811682 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.811809 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.811990 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.812113 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854267-1-iscsi {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.812301 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.812413 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.812631 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.812716 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.812952 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.813037 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.813288 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.813437 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.813595 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.813756 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.813842 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.814072 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.814166 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.814404 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.814509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.814736 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.814836 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.815046 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.815142 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.815354 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.815440 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.815663 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.815756 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.815965 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.816053 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.816273 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.816362 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.816606 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.816695 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.816914 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.817001 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.817221 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.817306 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.817530 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.817615 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.817858 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.818172 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.818356 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.818478 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.818683 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.818778 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.818944 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.819091 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.819266 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.819410 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.819598 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.819719 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.819929 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.820021 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.820264 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.820351 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.820620 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.820726 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.820881 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.820967 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.821212 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.821300 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.821534 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.821656 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.821848 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.821940 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.822152 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.822237 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.822459 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.822552 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.822770 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.822854 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.823075 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.823159 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.823386 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.823480 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.823699 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.823783 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.824004 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.824108 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.824310 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.824435 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.824657 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.824766 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.824965 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.825065 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.825275 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.825371 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.825580 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.825671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.825883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.825978 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.826189 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.826276 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.826495 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.826625 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.826800 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.826897 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.827103 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.827216 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.827403 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.827520 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.827726 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.827826 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.828054 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.828146 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.828365 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.828480 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.828697 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.828797 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.829007 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.829093 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.829327 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.829420 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.829664 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.829760 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.829976 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.830061 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.830231 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.830316 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.830541 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.830628 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.830853 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.830944 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.831180 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.831272 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.831495 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.831582 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.831811 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.831902 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.832124 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.832215 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.832458 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.832547 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.832777 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.832873 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.833091 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.833684 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.833983 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.834396 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.834483 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.834729 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.834827 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.835063 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.835159 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.835389 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.835484 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.835705 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.835788 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.836023 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.836111 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.836335 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.836458 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.836686 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.836815 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.837013 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.837089 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.837330 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.837406 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.837647 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.837741 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.837968 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.838044 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.838290 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.838389 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.838614 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.838699 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.838930 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.839018 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.839247 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.839424 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.839562 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.839651 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.839878 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.839954 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.840192 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.840328 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.840541 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.840700 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.840839 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.840976 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.841158 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.841302 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.841484 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.841636 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.841774 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.841888 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.842089 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.842166 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.842398 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.842500 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.842714 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.842789 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.843023 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.843107 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.843360 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.843466 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.843677 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.843771 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.843992 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.844084 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.844306 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.844461 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.844642 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.844743 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.844957 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.845054 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.845265 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.845387 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.845576 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.845661 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.845885 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.845979 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.846195 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.846290 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.846502 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.846588 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.846810 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.846895 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.847116 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.847201 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:35:25.847439 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.847524 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.847768 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.847861 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.848076 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.848163 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.848435 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.848538 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.848747 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.848890 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.849620 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.849936 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.850250 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.850347 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.850558 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.850658 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.850871 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.850957 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.851184 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.851270 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.851491 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.851586 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.851815 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.851901 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.852128 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.852221 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.852468 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.852570 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.852771 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.852857 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.853079 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.853172 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.853387 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.853481 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.853702 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.853796 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.854016 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.854098 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.854330 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.854416 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.854642 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.854729 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.855013 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.855114 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.855277 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.855380 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.855595 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.855689 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.855911 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.856002 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.856250 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.856337 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.856609 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.856710 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.856919 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.857005 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.857245 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.857333 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.857574 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.857661 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.857896 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.857990 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.858210 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.858303 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.858524 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.858652 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.858831 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.859000 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.859140 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.859226 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.859446 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.859544 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.859759 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.859854 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.860067 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.860153 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.860374 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.860515 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.860703 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.860802 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.861011 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.861098 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.861318 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.861403 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.861642 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.861730 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.861955 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.862040 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.862262 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.862347 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.862571 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.862658 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.862878 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.862964 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.863215 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.863300 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.863522 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.863609 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.863842 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.863927 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.864157 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.864242 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.864526 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.864628 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.864903 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.865225 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.865334 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.865539 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.865627 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.865852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.865938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.866167 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.866253 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.866481 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.866569 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.866795 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.866890 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.867118 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.867211 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.867433 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.867528 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.867755 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.867881 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.868072 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.868162 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.868439 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.868542 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.868735 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.868821 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.869059 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.869145 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.869367 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.869461 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.869687 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.869774 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.870021 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.870119 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.870343 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.870436 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.870658 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.870745 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.870982 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.871075 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.871294 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.871386 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.871607 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.871701 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.871917 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.872010 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.872230 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.872323 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.872569 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.872669 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.872885 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.872985 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.873201 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.873286 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.873512 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.873596 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.873834 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.873921 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.874149 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.874240 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.874471 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.874556 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.874782 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.874876 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.875104 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.875212 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.875415 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.875512 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.875729 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.875863 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.876058 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.876145 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.876366 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.876488 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.876716 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.876803 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.877028 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.877113 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.877340 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.877441 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.877652 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.877737 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.877966 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.878051 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.878275 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.878371 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.878582 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.878683 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.878890 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.878977 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.879199 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.879297 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.879509 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.879595 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.879818 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.879903 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.880175 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.880288 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.880591 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.880912 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.881141 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.881229 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.881465 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.881562 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.881784 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.881871 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.882115 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.882200 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.882443 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.882558 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.882754 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.882848 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.883079 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.883166 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.883402 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.883489 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.883708 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.883795 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.884016 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.884109 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.884341 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.884456 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.884683 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.884796 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.884983 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.885079 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.885290 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.885376 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.885596 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.885700 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.885932 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.886025 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.886243 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.886328 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.886550 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.886636 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.886870 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.886965 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.887195 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.887285 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.887507 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.887602 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.887831 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.887926 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.888142 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.888227 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.888475 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.888566 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.888803 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.888893 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.889118 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.889213 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.889427 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.889512 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.889739 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.889835 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.890051 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.890137 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.890363 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.890449 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.890677 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.890764 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.890991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.891086 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.891301 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.891386 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.891613 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.891700 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.891925 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.892018 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.892231 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.892316 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.892567 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.892656 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.892886 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.892971 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.893217 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.893469 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.893557 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.893806 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.893891 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.894124 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.894209 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.894446 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.894533 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.894768 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.894853 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.895092 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.895178 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.895403 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.895496 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.896254 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.896376 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.896622 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.896936 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.897103 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.897249 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.897425 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.897557 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.897747 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.897870 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.898071 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.898175 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.898386 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.898480 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.898699 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.898786 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.899016 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.899103 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.899336 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.899422 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.899653 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.899745 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.899960 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.900055 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.900267 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.900364 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.900600 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.900688 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.900916 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.901016 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.901219 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.901305 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.901524 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.901609 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.901827 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.901913 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.902151 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.902238 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.902460 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.902554 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.902765 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.902859 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.903071 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.903166 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.903377 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.903472 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.903683 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.903768 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.904012 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.904098 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.904328 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.904444 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.904670 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.904764 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.904982 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.905068 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.905291 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.905386 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.905631 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.905762 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.905945 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.906038 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.906252 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.906345 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.906560 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.906655 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.906866 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.906959 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.907180 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.907276 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.907493 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.907587 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.907804 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.907893 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.908116 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.908202 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.908443 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.908543 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.908760 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.908854 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.909071 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.909159 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.909377 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.909463 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.909897 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.910017 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.910101 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.910187 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.910344 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.910439 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.910654 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.910748 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.911217 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.911316 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.912092 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.912353 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.912458 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.912833 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.913046 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.913139 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.913364 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.913453 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.913688 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.913783 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.914019 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.914106 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.914337 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.914604 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.914699 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.914933 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.915018 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.915244 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.915331 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.915558 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.915653 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.915864 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.915956 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.916189 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.916274 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.916575 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.916677 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.916907 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.916992 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.917213 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.917299 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.917527 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.917635 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.917835 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.917929 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.918140 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.918235 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.918450 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.918534 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.918766 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.918853 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.919081 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.919166 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.919382 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.919467 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.919691 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.919785 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.919995 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.920079 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.920302 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.920471 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.920631 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.920708 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.920940 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.921024 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.921240 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.921333 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.921544 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.921630 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.921846 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.921933 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.922153 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.922255 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.922457 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.922543 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.922778 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.922865 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.923087 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.923181 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.923390 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.923484 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.923696 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.923792 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.923997 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.924091 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.924339 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.924494 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.924671 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.924766 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.925014 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.925101 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.925324 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.925409 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.925638 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.925723 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.925956 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.926043 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.926269 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.926354 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.926584 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.926670 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.926898 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.927003 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.927261 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.927681 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.927821 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.927992 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.928140 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.928305 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.928488 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.928636 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.928809 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.928943 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.929119 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.929267 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.929438 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.929581 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.929757 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.929895 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.930073 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.930220 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.930388 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.930545 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.930699 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.930871 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.931012 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.931184 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.931302 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.931492 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.931612 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.931804 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.931917 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.932115 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.932227 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.932442 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.932557 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.932756 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.932876 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.933064 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.933174 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.933380 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.933480 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.933695 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.933798 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.934008 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.934131 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.934320 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.934428 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.934629 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.934755 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.934938 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.935050 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.935242 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.935361 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.935545 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.935671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.935860 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.935985 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.936167 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.936290 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.936494 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.936628 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.936805 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.936905 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.937112 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.937206 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.937415 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.937540 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.937725 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.937821 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.938037 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.938156 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.938340 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.938473 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.938658 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.938808 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.938985 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.939097 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.939314 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.939445 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.939620 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.939733 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.939934 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.940031 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.940242 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.941081 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.941081 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.941371 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.941371 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.941538 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.941660 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.941765 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.941849 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.941977 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.942084 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.942168 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.942285 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.942393 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.942491 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.942628 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.942738 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.942890 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.943226 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.943563 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.943693 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.943890 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.944003 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.944206 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.944328 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.944549 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.944768 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.944865 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.944978 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.945159 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.945286 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.945499 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.945638 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.945868 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.945973 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.946168 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.946297 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.946494 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.946620 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.946821 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.946949 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.947138 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.947262 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.947458 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.947586 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.947778 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.947906 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.948090 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.948193 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.948458 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.948600 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.948744 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.948839 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.949057 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.949168 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.949367 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.949460 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.949677 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.949773 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.949998 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.950094 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.950308 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.950422 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.950612 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.950777 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.950935 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.951042 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.951261 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.951376 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.951576 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.951689 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.951887 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.952009 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.952201 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.952318 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.952585 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.952683 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.952907 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.953034 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.953223 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.953337 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.953539 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.953663 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.953856 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.953972 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.954172 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.954341 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.954480 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.954598 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.954785 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.954914 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.955094 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.955222 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.955404 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.955550 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.955712 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.955830 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.956024 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.956110 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.956336 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.956509 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.956674 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.956768 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.956984 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.957080 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.957290 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.957396 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.957598 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.957692 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.957908 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.958020 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.958781 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.958986 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.959203 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.959536 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.959753 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.959846 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.960085 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.960224 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.960424 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.960568 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.960755 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.960885 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.961072 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.961204 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.961377 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.961498 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.961687 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.961789 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.962009 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.962102 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.962327 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.962430 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.962637 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.962747 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.962969 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.963062 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.963303 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.963408 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.963620 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.963720 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.963954 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.964068 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.964267 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.964357 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.964609 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.964710 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.964928 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.965040 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.965251 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.965363 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.965559 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.965652 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.965864 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.965976 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.966169 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.966292 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.966477 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.966585 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.966787 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.966898 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.967092 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.967214 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.967402 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.967528 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.967711 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.967853 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.968022 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.968149 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.968327 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.968562 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.968687 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.968885 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.968993 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.969203 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.969300 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.969533 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.969638 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.969861 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.969981 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.970182 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.970292 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.970490 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.970594 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.970807 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.970930 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.971126 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.971243 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.971458 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.971583 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.971771 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.971888 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.972084 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.972202 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.972426 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.972564 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.972739 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.972857 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.973058 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.973179 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.973377 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.973514 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.973690 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.973833 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.974573 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.974897 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.975128 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.975264 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.975520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.975645 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.975839 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.975958 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.976158 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.976284 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.976588 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.976742 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.976924 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.977074 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.977254 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.977393 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.977550 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.977710 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.977875 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.978036 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.978186 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.978351 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.978502 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.978685 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.978833 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.978957 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.979142 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.979258 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.979459 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.979576 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.979773 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.979911 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.980088 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.980216 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.980513 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.980618 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.980721 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.980853 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.981045 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.981165 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.981357 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.981461 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.981685 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.981789 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.982003 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.982092 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.982333 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.982428 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.982661 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.982766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.982973 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.983070 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.983301 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.983399 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.983615 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.983704 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.983925 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.984019 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.984238 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.984332 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.984575 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.984713 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.984890 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.984986 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.985206 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.985302 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.985522 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.985618 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.985836 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.985933 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.986148 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.986310 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.986465 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.986548 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.986783 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.986870 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.987108 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.987204 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.987443 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.987544 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.987761 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.987847 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.988083 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.988171 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.988453 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.988545 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.988728 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.988817 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.989046 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.989249 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.989357 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.989592 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.989929 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.990255 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.990349 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.990580 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.990667 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.990899 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.990985 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.991213 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.991308 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.991525 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.991619 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.991832 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.991917 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.992141 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.992230 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.992483 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.992583 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.992797 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.992887 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.993104 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.993193 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.993417 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.993502 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.993727 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.993813 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.994035 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.994154 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.994395 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.994488 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.994704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.994848 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.995039 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.995238 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.995355 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.995594 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.995690 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.995914 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.996004 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.996244 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.996331 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.996598 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.996734 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.996921 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.997010 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.997230 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.997568 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.997712 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.997781 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.997863 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.997940 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.998156 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.998245 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.998472 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.998572 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.998785 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.998873 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.999091 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.999177 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.999398 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.999643 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.999734 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:25.999981 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.000069 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.000300 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.000412 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.000637 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.000726 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.000945 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.001032 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.001262 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.001347 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.001568 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.001653 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.001876 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.001972 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.002180 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.002276 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.002494 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.002582 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.002799 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.002885 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.003103 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.003188 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.003410 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.003493 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.003714 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.003801 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.004025 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.004120 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.004331 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.004455 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.004667 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.004756 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.004972 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.005109 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.005325 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.005628 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.005902 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.005991 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.006227 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.006315 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.006549 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.006636 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.006855 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.006941 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.007203 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.007294 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.007522 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.007619 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.007837 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.007933 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.008157 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.008244 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.008490 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.008579 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.008809 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.008909 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.009127 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.009221 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.009445 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.009540 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.009761 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.009993 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.010082 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.010327 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.010414 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.010650 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.010745 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.010989 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.011076 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.011323 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.011409 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.011635 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.011730 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.011946 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.012034 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.012253 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.012347 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.012606 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.012806 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.012921 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.013126 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.013235 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.013465 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.013553 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.013796 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.013883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.014131 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.014275 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.014494 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.014728 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.014828 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.015054 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.015142 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.015368 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.015455 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.015680 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.015768 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.015992 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.016079 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.016302 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.016389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.016663 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.016787 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.016936 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.017067 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.017246 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.017382 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.017567 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.017682 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.017896 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.018007 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.018205 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.018310 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.018525 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.018742 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.018830 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.019096 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.019184 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.019419 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.019509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.019738 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.019824 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.020049 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.020135 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.020359 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.020481 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.021250 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.021350 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.021588 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.022049 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.022136 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.022366 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.022455 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.022724 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.022810 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.023051 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.023139 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.023370 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.023457 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.023685 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.023772 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.023998 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.024086 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.024315 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.024448 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.024661 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.024765 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.024975 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.025060 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.025292 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.025379 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.025604 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.025706 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.025935 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.026025 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.026246 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.026334 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.026559 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.026655 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.026871 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.026958 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.027191 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.027278 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.027503 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.027666 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.027811 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.027924 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.028122 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.028225 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.028452 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.028564 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.028770 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.028859 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.029076 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.029164 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.029380 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.029466 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.029687 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.029772 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.029991 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.030085 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.030299 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.030386 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.030603 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.030688 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.030909 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.030995 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.031219 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.031306 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.031524 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.031619 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.031876 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.031982 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.032136 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.032223 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.032464 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.032566 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.032772 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.032868 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.033077 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.033163 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.033389 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.033475 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.033694 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.033790 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.034003 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.034098 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.034309 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.034601 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.034688 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.034903 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.034990 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.035238 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.035325 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.035573 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.035668 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.036137 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.036230 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.037093 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.037551 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.037637 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.037880 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.037970 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.038200 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.038287 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.038530 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.038617 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.038851 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.038938 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.039169 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.039254 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.039484 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.039571 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.039801 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.039888 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.040118 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.040203 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.040453 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.040561 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.040773 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.040860 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.041087 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.041187 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.041400 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.041503 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.041713 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.041802 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.042026 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.042112 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.042343 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.042440 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.042661 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.042747 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.042972 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.043059 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.043294 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.043389 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.043619 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.043704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.043938 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.044026 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.044254 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.044341 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.044603 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.044690 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.044918 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.045004 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.045234 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.045368 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.045546 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.045635 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.045860 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.045964 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.046173 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.046258 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.046492 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.046579 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.046805 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.046901 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.047119 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.047250 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.047431 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.047524 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.047748 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.047907 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.048078 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.048166 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.048420 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.048510 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.048747 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.048836 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.049078 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.049165 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.049406 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.049499 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.049757 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.049847 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.050073 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.050172 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.050401 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.050488 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.050721 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.050809 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.051038 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.051125 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.051355 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.051451 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.051665 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.051758 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.051933 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:35:26.052117 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.052952 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.053274 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.053593 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.053917 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.054276 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.054602 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.054920 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.055234 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.055553 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.055865 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.056178 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.056514 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.056829 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.057145 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.057461 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.057770 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.058078 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.058388 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.058697 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.059005 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.059320 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.059630 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.060027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.060255 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.060587 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.060898 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.061238 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.061577 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.061895 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.062227 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.062540 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.062864 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.063178 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.063505 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.063833 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.064154 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.064502 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.064843 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.065159 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.065476 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.065795 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.066111 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.066425 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.066739 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.067073 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.067414 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.068226 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.068608 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.068947 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.069285 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.069616 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.069940 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.070286 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.070606 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.070929 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.071249 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.071569 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.071890 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.072222 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.072561 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.072884 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.073209 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.073537 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.073870 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.074206 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.074525 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.074859 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.075195 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.075551 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.075871 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.076221 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.076583 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.076906 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.077225 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.077545 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:35:26.077790 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:35:26.206781 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO dbcounter [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Registered counter for database nova_api Aug 24 05:35:26.229363 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_db.sqlalchemy.engines [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:35:26.236164 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writer thread running {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:35:26.238601 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO dbcounter [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Registered counter for database nova_api Aug 24 05:35:26.260281 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG oslo_db.sqlalchemy.engines [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:35:26.267063 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG dbcounter [-] [112661] Writer thread running {{(pid=112661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:35:26.294946 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.context [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8836218-39fb-4108-99ef-4bb0f27daef8(cell1) {{(pid=112660) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 05:35:26.298764 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:26.299226 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:26.300887 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:26.301619 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:26.302672 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:26.304870 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:26.306973 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO dbcounter [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Registered counter for database nova_cell0 Aug 24 05:35:26.312738 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO dbcounter [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Registered counter for database nova_cell1 Aug 24 05:35:26.321247 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_db.sqlalchemy.engines [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:35:26.323086 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_db.sqlalchemy.engines [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:35:26.325875 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.context [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8836218-39fb-4108-99ef-4bb0f27daef8(cell1) {{(pid=112661) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 05:35:26.329801 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG oslo_concurrency.lockutils [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:26.329919 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writer thread running {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:35:26.330277 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG oslo_concurrency.lockutils [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:26.331266 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writer thread running {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:35:26.331854 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG oslo_concurrency.lockutils [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:26.332651 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG oslo_concurrency.lockutils [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:26.333094 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG oslo_concurrency.lockutils [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:26.335370 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG oslo_concurrency.lockutils [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:26.337403 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO dbcounter [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Registered counter for database nova_cell0 Aug 24 05:35:26.342952 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO dbcounter [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Registered counter for database nova_cell1 Aug 24 05:35:26.351914 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG oslo_db.sqlalchemy.engines [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:35:26.353734 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG oslo_db.sqlalchemy.engines [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:35:26.359531 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG dbcounter [-] [112661] Writer thread running {{(pid=112661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:35:26.365464 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG dbcounter [-] [112661] Writer thread running {{(pid=112661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:35:26.480605 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO dbcounter [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Registered counter for database nova_cell0 Aug 24 05:35:26.490232 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_db.sqlalchemy.engines [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:35:26.494704 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writer thread running {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:35:26.509032 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO dbcounter [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Registered counter for database nova_cell0 Aug 24 05:35:26.516964 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG oslo_db.sqlalchemy.engines [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:35:26.521698 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG dbcounter [-] [112661] Writer thread running {{(pid=112661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:35:26.916212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: WARNING keystonemiddleware.auth_token [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:35:26.923571 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: WARNING keystonemiddleware.auth_token [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:35:26.924342 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: WARNING keystonemiddleware.auth_token [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:35:26.931833 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: WARNING keystonemiddleware.auth_token [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:35:27.272183 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: WARNING keystonemiddleware.auth_token [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:35:27.278590 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: WARNING keystonemiddleware.auth_token [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:35:27.281366 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: WARNING keystonemiddleware.auth_token [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:35:27.284080 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556e2e1ae9c0 pid: 112660 (default app) Aug 24 05:35:27.287358 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:27.288513 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: WARNING keystonemiddleware.auth_token [None req-baba8bc9-8f17-4f01-b249-be436aa4a8a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:35:27.288663 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002852 Aug 24 05:35:27.289041 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Wed Aug 24 05:35:27 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:35:27.293895 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556e2e1ae9c0 pid: 112661 (default app) Aug 24 05:36:51.124919 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:51.126543 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Aug 24 05:36:51.132715 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:36:51 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:36:51.140391 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG dbcounter [-] [112661] Writing DB stats nova_api:SELECT=3 {{(pid=112661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:51.141320 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG dbcounter [-] [112661] Writing DB stats nova_cell0:SELECT=3 {{(pid=112661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:51.143093 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG dbcounter [-] [112661] Writing DB stats nova_cell1:SELECT=3 {{(pid=112661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:51.144484 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG dbcounter [-] [112661] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:52.055035 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-a6f6c942-4f2f-40cd-8736-9acd691e6f9d admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:52.087909 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-a6f6c942-4f2f-40cd-8736-9acd691e6f9d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.953150 Aug 24 05:36:52.088708 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 24 05:36:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:36:54.484689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:54.484689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-c4fe0249-4d11-463c-b9c6-834f59e80098 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 24 05:36:54.484689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:36:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:36:54.954815 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-9d1959b6-84ca-4d64-a6f1-95494aede771 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:36:54.980584 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:36:54.980584 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: warnings.warn(msg) Aug 24 05:36:55.078485 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-9d1959b6-84ca-4d64-a6f1-95494aede771 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.584756 Aug 24 05:36:55.079311 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 24 05:36:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:36:55.094205 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writing DB stats nova_api:SELECT=3 {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:55.097639 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writing DB stats nova_cell0:SELECT=3 {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:55.097639 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writing DB stats nova_cell1:SELECT=3 {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:55.097639 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:55.317837 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-2fa06080-f875-4485-8cdb-39edeba06533 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:36:55.322396 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:36:55.322396 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: warnings.warn(msg) Aug 24 05:36:55.452732 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-2fa06080-f875-4485-8cdb-39edeba06533 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.364594 Aug 24 05:36:55.453319 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 24 05:36:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:36:57.821593 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-9d1959b6-84ca-4d64-a6f1-95494aede771 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:57.822445 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-9d1959b6-84ca-4d64-a6f1-95494aede771 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 24 05:36:57.822847 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:36:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:36:58.518835 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-b23f5d99-c4b1-4ccd-82de-2e4cb738574a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:36:58.538261 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:36:58.538261 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: warnings.warn(msg) Aug 24 05:36:58.646219 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-b23f5d99-c4b1-4ccd-82de-2e4cb738574a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.816982 Aug 24 05:36:58.647396 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 24 05:36:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:36:58.659498 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-46af5927-ee8b-4c03-b812-9c3713d5f037 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:36:58.662647 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:36:58.662647 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: warnings.warn(msg) Aug 24 05:36:58.775045 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-46af5927-ee8b-4c03-b812-9c3713d5f037 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119281 Aug 24 05:36:58.775784 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 24 05:36:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:37:01.179034 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-b23f5d99-c4b1-4ccd-82de-2e4cb738574a admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:01.180642 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-b23f5d99-c4b1-4ccd-82de-2e4cb738574a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Aug 24 05:37:01.181504 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:37:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:01.593608 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-463693ed-3c12-4eb6-8058-b683f46479ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:01.674087 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-463693ed-3c12-4eb6-8058-b683f46479ea admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485614 Aug 24 05:37:01.674582 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 24 05:37:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:37:01.686891 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-bd207874-e7dc-4fee-bf2e-c975bff40aca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:01.808689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-bd207874-e7dc-4fee-bf2e-c975bff40aca admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125423 Aug 24 05:37:01.809406 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 24 05:37:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:37:04.199225 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-463693ed-3c12-4eb6-8058-b683f46479ea admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:04.200242 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-463693ed-3c12-4eb6-8058-b683f46479ea admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 24 05:37:04.200679 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:37:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:04.641964 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-9e796fdc-6751-4746-baf3-bda9d6ef62f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:04.708383 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-9e796fdc-6751-4746-baf3-bda9d6ef62f4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.501369 Aug 24 05:37:04.709351 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 24 05:37:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:37:04.722477 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-f140910b-a8f8-4552-9958-3cfd50eeec8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:04.786156 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-f140910b-a8f8-4552-9958-3cfd50eeec8e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067745 Aug 24 05:37:04.786992 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 24 05:37:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:37:07.201429 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-9e796fdc-6751-4746-baf3-bda9d6ef62f4 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:07.202450 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-9e796fdc-6751-4746-baf3-bda9d6ef62f4 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 24 05:37:07.202837 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:37:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:07.654248 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-fa19c4d9-6d8c-4f59-abb6-959e65069411 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "vcpus": 4, "disk": 20}} {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:07.719242 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-fa19c4d9-6d8c-4f59-abb6-959e65069411 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510006 Aug 24 05:37:07.720668 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 24 05:37:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:37:07.733220 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-e44334b4-afbd-463a-8e69-1bd18e68f9ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:07.804424 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-e44334b4-afbd-463a-8e69-1bd18e68f9ef admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075107 Aug 24 05:37:07.804979 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 24 05:37:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:37:10.561350 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-fa19c4d9-6d8c-4f59-abb6-959e65069411 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:10.563153 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-fa19c4d9-6d8c-4f59-abb6-959e65069411 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002619 Aug 24 05:37:10.564595 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:11.042714 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-ba7683d6-634e-49bd-9621-f916b3df73ad admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:11.069778 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-ba7683d6-634e-49bd-9621-f916b3df73ad admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.498099 Aug 24 05:37:11.070377 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 24 05:37:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:13.580146 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-fa19c4d9-6d8c-4f59-abb6-959e65069411 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:13.581428 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-fa19c4d9-6d8c-4f59-abb6-959e65069411 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002389 Aug 24 05:37:13.581820 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:37:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:14.101861 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-5a863dc7-29ff-4b3f-b45d-9f4141d4ae60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "1", "ram": 512}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:14.184361 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-5a863dc7-29ff-4b3f-b45d-9f4141d4ae60 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.595142 Aug 24 05:37:14.185146 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 24 05:37:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:37:14.198095 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-fe16f0d7-14ec-4a36-a629-582513d023a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:14.300749 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-fe16f0d7-14ec-4a36-a629-582513d023a5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106654 Aug 24 05:37:14.301514 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 24 05:37:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:37:16.714576 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-5a863dc7-29ff-4b3f-b45d-9f4141d4ae60 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:16.715604 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-5a863dc7-29ff-4b3f-b45d-9f4141d4ae60 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 24 05:37:16.716003 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:17.114984 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-6ff75228-8133-4900-a32c-7af9673db444 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "id": "2", "disk": 20}} {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:17.198740 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-6ff75228-8133-4900-a32c-7af9673db444 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.475788 Aug 24 05:37:17.201745 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 24 05:37:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:37:17.211441 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-35003e11-7a65-4b65-b69a-e4e13f5a176d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:17.294315 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-35003e11-7a65-4b65-b69a-e4e13f5a176d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086365 Aug 24 05:37:17.294820 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 24 05:37:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:37:19.767679 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-6ff75228-8133-4900-a32c-7af9673db444 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:19.769352 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-6ff75228-8133-4900-a32c-7af9673db444 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003106 Aug 24 05:37:19.772773 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:37:19 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:20.239417 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-0b40df23-048e-494c-ba8b-7ef8d0c9a6d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "swap": 0}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:20.302198 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-0b40df23-048e-494c-ba8b-7ef8d0c9a6d1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.525887 Aug 24 05:37:20.303058 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 24 05:37:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:37:20.316989 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-59d2bac4-25dd-4ba4-8f98-1e85b0cc8765 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:20.427094 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-59d2bac4-25dd-4ba4-8f98-1e85b0cc8765 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115496 Aug 24 05:37:20.427811 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 24 05:37:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:37:22.950494 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-0b40df23-048e-494c-ba8b-7ef8d0c9a6d1 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:22.952211 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-0b40df23-048e-494c-ba8b-7ef8d0c9a6d1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002142 Aug 24 05:37:22.964199 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:23.401546 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-786ac47e-e90b-4692-b2a0-d79b06dd77ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:23.407955 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG dbcounter [-] [112661] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:23.467181 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-786ac47e-e90b-4692-b2a0-d79b06dd77ce admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506926 Aug 24 05:37:23.467746 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 24 05:37:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:37:23.480219 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-3bda960d-b07e-4400-94d1-642e9dc482ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:23.562865 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-3bda960d-b07e-4400-94d1-642e9dc482ad admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086151 Aug 24 05:37:23.564605 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 24 05:37:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:37:25.982644 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-786ac47e-e90b-4692-b2a0-d79b06dd77ce admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:25.983662 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-786ac47e-e90b-4692-b2a0-d79b06dd77ce admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 24 05:37:25.984075 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:26.453995 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-05a46c5f-14cb-4d57-a3b7-4f8a2aee5114 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "ram": 16384, "id": "5"}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:26.567006 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-05a46c5f-14cb-4d57-a3b7-4f8a2aee5114 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.575633 Aug 24 05:37:26.572459 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 24 05:37:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:37:26.590119 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-ecac4a70-fb38-47a2-a477-e6406afc5d37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:26.966847 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-ecac4a70-fb38-47a2-a477-e6406afc5d37 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.380851 Aug 24 05:37:26.967715 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 24 05:37:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:37:46.493894 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-05a46c5f-14cb-4d57-a3b7-4f8a2aee5114 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:46.494835 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-05a46c5f-14cb-4d57-a3b7-4f8a2aee5114 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 24 05:37:46.495239 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:37:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:46.506433 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG dbcounter [-] [112661] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:46.908436 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-28a08b3d-3285-4ac9-baa4-a5fc26bf5d26 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:46.928740 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-28a08b3d-3285-4ac9-baa4-a5fc26bf5d26 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.426653 Aug 24 05:37:46.929282 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 24 05:37:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:48.003133 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-05a46c5f-14cb-4d57-a3b7-4f8a2aee5114 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:48.004559 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-05a46c5f-14cb-4d57-a3b7-4f8a2aee5114 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 24 05:37:48.004708 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:37:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:48.532933 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-902e87ed-be52-4dca-bf0e-36ccf79c33eb admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:48.538734 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.wsgi [None req-902e87ed-be52-4dca-bf0e-36ccf79c33eb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-902e87ed-be52-4dca-bf0e-36ccf79c33eb admin admin] Request method failure captured: Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Accept: application/json Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Accept-Encoding: gzip, deflate Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Connection: keep-alive Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Content-Length: 0 Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Host: 10.222.0.15 Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Openstack-Api-Version: compute 2.90 Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Openstack-System-Scope: None Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: User-Agent: python-novaclient Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Auth-Token: gAAAAABjBbkrwSdUyobo-Q0RqvDpbIMqa0a0nY_7c-B4yCJT2g2tTHk1k7LT3Tugn32GhYUxpdYWJT2wbsYtX4dod68S62tke7u0kd9NsaRVcq-JWV1ka2qv6TYYQ_7YKaZ2eOlrKIDKy_MbMpzxv4f4-gqZkspWsTBoSsnKiAfPVc-69TFquUU Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Domain-Id: None Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Domain-Name: None Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Identity-Status: Confirmed Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Is-Admin-Project: True Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Domain-Id: default Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Domain-Name: Default Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Name: admin Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Role: reader,member,admin Aug 24 05:37:48.541991 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Roles: reader,member,admin Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_617e47339cb94e20967707fe62db290d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/617e47339cb94e20967707fe62db290d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}] Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Tenant: admin Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Tenant-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Tenant-Name: admin Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User: admin Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Domain-Id: default Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Domain-Name: Default Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Id: 359799b7d001453b90d984a05215cce6 Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Name: admin Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: method: > Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: exception: Flavor 42 could not be found. Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: action_args: {'id': '42'} Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:37:48.543621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:48.544622 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:48.545767 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-902e87ed-be52-4dca-bf0e-36ccf79c33eb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:37:48.547651 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-902e87ed-be52-4dca-bf0e-36ccf79c33eb admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397505 Aug 24 05:37:48.547651 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 24 05:37:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:48.553765 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-38d4f6af-2766-48ea-aede-dfed659831a5 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:48.558054 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:48.577214 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-38d4f6af-2766-48ea-aede-dfed659831a5 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026985 Aug 24 05:37:48.578132 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 24 05:37:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:48.588227 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-e50a3ea5-9864-4c32-8fee-a8e9a65d8c40 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:48.613463 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-e50a3ea5-9864-4c32-8fee-a8e9a65d8c40 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028763 Aug 24 05:37:48.614026 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 24 05:37:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:48.623555 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-1cbbdbbf-71af-4b12-bb2a-d824292f77cd admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:48.629825 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.wsgi [None req-1cbbdbbf-71af-4b12-bb2a-d824292f77cd admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-1cbbdbbf-71af-4b12-bb2a-d824292f77cd admin admin] Request method failure captured: Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Accept: application/json Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Accept-Encoding: gzip, deflate Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Connection: keep-alive Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Content-Length: 0 Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Host: 10.222.0.15 Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Openstack-Api-Version: compute 2.90 Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Openstack-System-Scope: None Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: User-Agent: python-novaclient Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Auth-Token: gAAAAABjBbkrwSdUyobo-Q0RqvDpbIMqa0a0nY_7c-B4yCJT2g2tTHk1k7LT3Tugn32GhYUxpdYWJT2wbsYtX4dod68S62tke7u0kd9NsaRVcq-JWV1ka2qv6TYYQ_7YKaZ2eOlrKIDKy_MbMpzxv4f4-gqZkspWsTBoSsnKiAfPVc-69TFquUU Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Domain-Id: None Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Domain-Name: None Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Identity-Status: Confirmed Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Is-Admin-Project: True Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Domain-Id: default Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Domain-Name: Default Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Name: admin Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Role: reader,member,admin Aug 24 05:37:48.633384 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Roles: reader,member,admin Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_617e47339cb94e20967707fe62db290d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/617e47339cb94e20967707fe62db290d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}] Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Tenant: admin Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Tenant-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Tenant-Name: admin Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User: admin Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Domain-Id: default Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Domain-Name: Default Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Id: 359799b7d001453b90d984a05215cce6 Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Name: admin Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: method: > Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: exception: Flavor 42 could not be found. Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: action_args: {'id': '42'} Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:37:48.634953 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:48.635883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:48.641509 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-1cbbdbbf-71af-4b12-bb2a-d824292f77cd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:37:48.642821 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-1cbbdbbf-71af-4b12-bb2a-d824292f77cd admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014736 Aug 24 05:37:48.642821 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 24 05:37:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:49.630522 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-e50a3ea5-9864-4c32-8fee-a8e9a65d8c40 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:49.631541 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-e50a3ea5-9864-4c32-8fee-a8e9a65d8c40 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 24 05:37:49.631938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:37:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:50.170711 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-f0cb3ac7-67fa-4617-977b-09545914bf71 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:50.176715 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.wsgi [None req-f0cb3ac7-67fa-4617-977b-09545914bf71 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-f0cb3ac7-67fa-4617-977b-09545914bf71 admin admin] Request method failure captured: Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Accept: application/json Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Accept-Encoding: gzip, deflate Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Connection: keep-alive Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Content-Length: 0 Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Host: 10.222.0.15 Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Openstack-Api-Version: compute 2.90 Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Openstack-System-Scope: None Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: User-Agent: python-novaclient Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Auth-Token: gAAAAABjBbktxRaFnruEZRm1wsgDICChRjkwZFruMQzMPIYMMKXlSe7aKYyRriQpyO58NfNN_06yXT5daNE_4XelJgSOBkqyNenLR5JrsolAn3CrMTPRQO9jRGSVbvx_0rBsrJXvaiG04RthxkBdWF0q8UF25-uAfE_2tPUEWKAcCu_SaH8lYAg Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Domain-Id: None Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Domain-Name: None Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Identity-Status: Confirmed Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Is-Admin-Project: True Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Domain-Id: default Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Domain-Name: Default Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Name: admin Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Role: reader,member,admin Aug 24 05:37:50.181689 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Roles: reader,member,admin Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_617e47339cb94e20967707fe62db290d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/617e47339cb94e20967707fe62db290d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}] Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Tenant: admin Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Tenant-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Tenant-Name: admin Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User: admin Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Domain-Id: default Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Domain-Name: Default Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Id: 359799b7d001453b90d984a05215cce6 Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Name: admin Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: method: > Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: exception: Flavor 84 could not be found. Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: action_args: {'id': '84'} Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:37:50.183520 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:50.184528 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:50.185852 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-f0cb3ac7-67fa-4617-977b-09545914bf71 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:37:50.187703 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-f0cb3ac7-67fa-4617-977b-09545914bf71 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.408830 Aug 24 05:37:50.187703 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 24 05:37:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:50.192526 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-8b1d6e1d-1464-4f90-8d94-4487c35666c0 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:50.207565 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-8b1d6e1d-1464-4f90-8d94-4487c35666c0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018559 Aug 24 05:37:50.210757 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 24 05:37:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:50.218534 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-0f9fa457-5f04-462a-84da-4a3f38ad08ce admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:50.235675 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-0f9fa457-5f04-462a-84da-4a3f38ad08ce admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021254 Aug 24 05:37:50.240883 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 24 05:37:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:50.249211 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-d93f6783-0e8e-4f07-a165-aacb2c4b49e6 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:50.254878 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.wsgi [None req-d93f6783-0e8e-4f07-a165-aacb2c4b49e6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-d93f6783-0e8e-4f07-a165-aacb2c4b49e6 admin admin] Request method failure captured: Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Accept: application/json Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Accept-Encoding: gzip, deflate Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Connection: keep-alive Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Content-Length: 0 Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Host: 10.222.0.15 Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Openstack-Api-Version: compute 2.90 Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Openstack-System-Scope: None Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: User-Agent: python-novaclient Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Auth-Token: gAAAAABjBbktxRaFnruEZRm1wsgDICChRjkwZFruMQzMPIYMMKXlSe7aKYyRriQpyO58NfNN_06yXT5daNE_4XelJgSOBkqyNenLR5JrsolAn3CrMTPRQO9jRGSVbvx_0rBsrJXvaiG04RthxkBdWF0q8UF25-uAfE_2tPUEWKAcCu_SaH8lYAg Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Domain-Id: None Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Domain-Name: None Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Identity-Status: Confirmed Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Is-Admin-Project: True Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Domain-Id: default Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Domain-Name: Default Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Name: admin Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Role: reader,member,admin Aug 24 05:37:50.256389 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Roles: reader,member,admin Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_617e47339cb94e20967707fe62db290d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/617e47339cb94e20967707fe62db290d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}] Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Tenant: admin Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Tenant-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Tenant-Name: admin Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User: admin Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Domain-Id: default Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Domain-Name: Default Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Id: 359799b7d001453b90d984a05215cce6 Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Name: admin Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: method: > Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: exception: Flavor 84 could not be found. Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: action_args: {'id': '84'} Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:37:50.257961 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:50.258938 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:50.260319 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-d93f6783-0e8e-4f07-a165-aacb2c4b49e6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:37:50.261567 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-d93f6783-0e8e-4f07-a165-aacb2c4b49e6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012406 Aug 24 05:37:50.261567 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 24 05:37:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:51.278746 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-0f9fa457-5f04-462a-84da-4a3f38ad08ce admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:51.279761 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-0f9fa457-5f04-462a-84da-4a3f38ad08ce admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 24 05:37:51.280162 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:37:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:51.895122 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-47d4f3be-ff35-4163-85ee-00d3010b6903 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:51.901463 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.wsgi [None req-47d4f3be-ff35-4163-85ee-00d3010b6903 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-47d4f3be-ff35-4163-85ee-00d3010b6903 admin admin] Request method failure captured: Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Accept: application/json Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Accept-Encoding: gzip, deflate Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Connection: keep-alive Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Content-Length: 0 Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Host: 10.222.0.15 Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Openstack-Api-Version: compute 2.90 Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Openstack-System-Scope: None Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: User-Agent: python-novaclient Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Auth-Token: gAAAAABjBbkvwOEMSaXlVt2w9f5Gof6LhzznKd5ksPH6okdPe4OmW4h2NDLOdWg7vdxZQ6AcKK90CGSJ42FD6FcPXcz50knr29FZSR2C_kffqXcd-Cl8SWBguohUtDcQvxJjnobiHxZ4xZ-hZmlags92CfYCra2CUvZXSpqrHie6z4QUIuChzNo Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Domain-Id: None Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Domain-Name: None Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Identity-Status: Confirmed Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Is-Admin-Project: True Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Domain-Id: default Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Domain-Name: Default Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Project-Name: admin Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Role: reader,member,admin Aug 24 05:37:51.903027 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Roles: reader,member,admin Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_617e47339cb94e20967707fe62db290d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/617e47339cb94e20967707fe62db290d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}] Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Tenant: admin Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Tenant-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-Tenant-Name: admin Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User: admin Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Domain-Id: default Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Domain-Name: Default Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Id: 359799b7d001453b90d984a05215cce6 Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: X-User-Name: admin Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: method: > Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: exception: Flavor 451 could not be found. Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: action_args: {'id': '451'} Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:37:51.904671 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:51.906218 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: ERROR nova.api.openstack.wsgi Aug 24 05:37:51.907704 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-47d4f3be-ff35-4163-85ee-00d3010b6903 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:37:51.908735 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-47d4f3be-ff35-4163-85ee-00d3010b6903 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.479552 Aug 24 05:37:51.908735 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 24 05:37:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 481 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:51.916482 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-002db44c-4f76-4002-b7b2-088378a51e24 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:51.943084 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-002db44c-4f76-4002-b7b2-088378a51e24 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031309 Aug 24 05:37:51.943634 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 24 05:37:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:51.954224 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:51.971730 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021789 Aug 24 05:37:51.972317 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 24 05:37:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:51.984436 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-1f64851e-ec77-49b3-a2a5-dd40bbeae6cd admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:51.992357 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.wsgi [None req-1f64851e-ec77-49b3-a2a5-dd40bbeae6cd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-1f64851e-ec77-49b3-a2a5-dd40bbeae6cd admin admin] Request method failure captured: Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Accept: application/json Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Accept-Encoding: gzip, deflate Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Connection: keep-alive Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Content-Length: 0 Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Host: 10.222.0.15 Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Openstack-Api-Version: compute 2.90 Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Openstack-System-Scope: None Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: User-Agent: python-novaclient Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Auth-Token: gAAAAABjBbkvwOEMSaXlVt2w9f5Gof6LhzznKd5ksPH6okdPe4OmW4h2NDLOdWg7vdxZQ6AcKK90CGSJ42FD6FcPXcz50knr29FZSR2C_kffqXcd-Cl8SWBguohUtDcQvxJjnobiHxZ4xZ-hZmlags92CfYCra2CUvZXSpqrHie6z4QUIuChzNo Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Domain-Id: None Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Domain-Name: None Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Identity-Status: Confirmed Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Is-Admin-Project: True Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Domain-Id: default Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Domain-Name: Default Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Project-Name: admin Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Role: reader,member,admin Aug 24 05:37:51.994212 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Roles: reader,member,admin Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_617e47339cb94e20967707fe62db290d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/617e47339cb94e20967707fe62db290d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/617e47339cb94e20967707fe62db290d"}]}] Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Tenant: admin Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Tenant-Id: 617e47339cb94e20967707fe62db290d Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-Tenant-Name: admin Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User: admin Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Domain-Id: default Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Domain-Name: Default Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Id: 359799b7d001453b90d984a05215cce6 Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: X-User-Name: admin Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: method: > Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: exception: Flavor 451 could not be found. Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: action_args: {'id': '451'} Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:37:51.995882 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:51.996758 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: ERROR nova.api.openstack.wsgi Aug 24 05:37:52.004766 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-1f64851e-ec77-49b3-a2a5-dd40bbeae6cd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:37:52.005915 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-1f64851e-ec77-49b3-a2a5-dd40bbeae6cd admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017179 Aug 24 05:37:52.005915 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 24 05:37:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 05:37:53.008148 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:53.009232 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 24 05:37:53.009635 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:37:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:53.545710 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-7b3cd20f-4708-417c-91c3-6ecc517e80fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:53.615553 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-7b3cd20f-4708-417c-91c3-6ecc517e80fc admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.466894 Aug 24 05:37:53.616118 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 24 05:37:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:37:54.616020 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:54.617073 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 05:37:54.617472 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:37:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:55.151804 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-a3892766-f9f6-4b9d-b5fd-9aaa0e0b90d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:55.248958 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-a3892766-f9f6-4b9d-b5fd-9aaa0e0b90d4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.492222 Aug 24 05:37:55.250386 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 24 05:37:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:37:56.224286 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:56.225336 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 05:37:56.225735 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:37:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:56.769722 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-fc8dfbc8-0d3f-40a3-9804-72cfd9b9c311 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:56.844347 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-fc8dfbc8-0d3f-40a3-9804-72cfd9b9c311 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.479023 Aug 24 05:37:56.844921 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 24 05:37:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:37:57.848709 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:57.849722 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 24 05:37:57.850119 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:37:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:37:58.379626 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-1226adcc-0470-4e1b-8715-a61865f6e442 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:58.438004 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-1226adcc-0470-4e1b-8715-a61865f6e442 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.446126 Aug 24 05:37:58.438601 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 24 05:37:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:37:59.452884 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:59.453904 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Aug 24 05:37:59.454613 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:37:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:59.988591 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-4f597e13-fd07-4fba-9b49-136dde1005c6 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:00.009942 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-4f597e13-fd07-4fba-9b49-136dde1005c6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.417477 Aug 24 05:38:00.010413 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Wed Aug 24 05:37:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:54.653445 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:54.655035 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-a5024f12-1de1-4e26-992d-81dabfe892ee admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 24 05:38:54.655447 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 24 05:38:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:38:54.666345 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:55.057303 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-efe099b1-c0eb-4947-9efd-b1ce3e043dd6 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:55.080880 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-efe099b1-c0eb-4947-9efd-b1ce3e043dd6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.419179 Aug 24 05:38:55.081441 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 24 05:38:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:55.102770 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG dbcounter [-] [112661] Writing DB stats nova_api:SELECT=14 {{(pid=112661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:55.106621 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-a980efc0-1b1a-41ff-a8b4-aae33e21747d admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:55.115515 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-a980efc0-1b1a-41ff-a8b4-aae33e21747d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014142 Aug 24 05:38:55.117007 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Wed Aug 24 05:38:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:38:55.128999 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-f645aee9-727e-45db-a287-4c9ff31b9f41 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:55.137094 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-f645aee9-727e-45db-a287-4c9ff31b9f41 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011678 Aug 24 05:38:55.137650 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Wed Aug 24 05:38:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:38:55.149963 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-df786b39-b78d-457d-9f17-ef5008cae516 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:55.158855 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-df786b39-b78d-457d-9f17-ef5008cae516 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012674 Aug 24 05:38:55.159336 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Wed Aug 24 05:38:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:38:55.172511 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-2d43e74c-6a7c-4494-aeea-d0d43e7727a6 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:55.180432 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-2d43e74c-6a7c-4494-aeea-d0d43e7727a6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012704 Aug 24 05:38:55.181171 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Wed Aug 24 05:38:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:42:21.239266 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-df786b39-b78d-457d-9f17-ef5008cae516 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:21.240290 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-df786b39-b78d-457d-9f17-ef5008cae516 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 05:42:21.240755 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:42:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:42:21.393218 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writing DB stats nova_api:SELECT=6 {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:21.596147 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-e74ca2e9-d1a6-461c-bf63-c8db9bfce390 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:21.598529 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:21.598529 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: warnings.warn(msg) Aug 24 05:42:21.599654 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-e74ca2e9-d1a6-461c-bf63-c8db9bfce390 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:21.600122 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-e74ca2e9-d1a6-461c-bf63-c8db9bfce390 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:21.600586 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-e74ca2e9-d1a6-461c-bf63-c8db9bfce390 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:21.601292 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-e74ca2e9-d1a6-461c-bf63-c8db9bfce390 admin admin] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:21.601732 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-e74ca2e9-d1a6-461c-bf63-c8db9bfce390 admin admin] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:21.602684 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-e74ca2e9-d1a6-461c-bf63-c8db9bfce390 admin admin] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:21.638780 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-e74ca2e9-d1a6-461c-bf63-c8db9bfce390 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.247381 Aug 24 05:42:21.639360 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 24 05:42:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:42:22.507832 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-df786b39-b78d-457d-9f17-ef5008cae516 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:22.510310 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-df786b39-b78d-457d-9f17-ef5008cae516 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003001 Aug 24 05:42:22.510725 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:42:22.711472 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-4765f97d-e1c2-4571-976f-c3b254a4f8f2 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:22.714133 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:22.714133 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: warnings.warn(msg) Aug 24 05:42:22.715278 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4765f97d-e1c2-4571-976f-c3b254a4f8f2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:22.715754 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4765f97d-e1c2-4571-976f-c3b254a4f8f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:22.716185 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4765f97d-e1c2-4571-976f-c3b254a4f8f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:22.716932 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4765f97d-e1c2-4571-976f-c3b254a4f8f2 admin admin] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:22.717380 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4765f97d-e1c2-4571-976f-c3b254a4f8f2 admin admin] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:22.717797 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4765f97d-e1c2-4571-976f-c3b254a4f8f2 admin admin] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:22.737486 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-4765f97d-e1c2-4571-976f-c3b254a4f8f2 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079383 Aug 24 05:42:22.738051 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 24 05:42:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:42:34.047905 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-df786b39-b78d-457d-9f17-ef5008cae516 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:34.054913 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-df786b39-b78d-457d-9f17-ef5008cae516 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 24 05:42:34.054913 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:42:34.203018 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writing DB stats nova_cell0:SELECT=4 {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:34.203730 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writing DB stats nova_cell1:SELECT=4 {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:34.204618 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG dbcounter [-] [112660] Writing DB stats nova_api:SELECT=8 {{(pid=112660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:34.257119 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-4b56967f-66cb-411e-b88f-f73102027e81 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:34.260734 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:34.260734 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: warnings.warn(msg) Aug 24 05:42:34.261927 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4b56967f-66cb-411e-b88f-f73102027e81 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:34.262409 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4b56967f-66cb-411e-b88f-f73102027e81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:34.262844 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4b56967f-66cb-411e-b88f-f73102027e81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:34.263564 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4b56967f-66cb-411e-b88f-f73102027e81 admin admin] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:34.264014 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4b56967f-66cb-411e-b88f-f73102027e81 admin admin] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:34.264455 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-4b56967f-66cb-411e-b88f-f73102027e81 admin admin] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:34.293674 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-4b56967f-66cb-411e-b88f-f73102027e81 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095110 Aug 24 05:42:34.294472 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 24 05:42:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:42:35.169919 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: DEBUG nova.api.openstack.wsgi [None req-df786b39-b78d-457d-9f17-ef5008cae516 admin admin] Calling method '>' {{(pid=112661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:35.170980 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: INFO nova.api.openstack.requestlog [None req-df786b39-b78d-457d-9f17-ef5008cae516 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 24 05:42:35.171695 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: [pid: 112661|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 24 05:42:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:42:35.376432 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG nova.api.openstack.wsgi [None req-24e3927e-508d-4eca-a86a-76a075df1621 admin admin] Calling method '>' {{(pid=112660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:35.378684 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:35.378684 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: warnings.warn(msg) Aug 24 05:42:35.379782 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-24e3927e-508d-4eca-a86a-76a075df1621 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:35.380254 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-24e3927e-508d-4eca-a86a-76a075df1621 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:35.380744 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-24e3927e-508d-4eca-a86a-76a075df1621 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:35.381445 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-24e3927e-508d-4eca-a86a-76a075df1621 admin admin] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:35.381890 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-24e3927e-508d-4eca-a86a-76a075df1621 admin admin] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:35.382334 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: DEBUG oslo_concurrency.lockutils [None req-24e3927e-508d-4eca-a86a-76a075df1621 admin admin] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:35.405243 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: INFO nova.api.openstack.requestlog [None req-24e3927e-508d-4eca-a86a-76a075df1621 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091175 Aug 24 05:42:35.405817 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: [pid: 112660|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 24 05:42:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:43:38.840712 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: Wed Aug 24 05:43:38 2022 - graceful shutdown triggered... Aug 24 05:43:38.840853 dv-cinder-854267-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 05:43:38.841737 dv-cinder-854267-1-iscsi devstack@n-api.service[112660]: Gracefully killing worker 1 (pid: 112660)... Aug 24 05:43:38.842112 dv-cinder-854267-1-iscsi devstack@n-api.service[112661]: Gracefully killing worker 2 (pid: 112661)... Aug 24 05:43:39.842238 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: worker 1 buried after 1 seconds Aug 24 05:43:39.842838 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: worker 2 buried after 1 seconds Aug 24 05:43:39.842838 dv-cinder-854267-1-iscsi devstack@n-api.service[112659]: goodbye to uWSGI. Aug 24 05:43:39.844047 dv-cinder-854267-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 05:43:39.844696 dv-cinder-854267-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 05:43:39.848510 dv-cinder-854267-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 05:43:39.863103 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 05:43:39 2022] *** Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: nodename: dv-cinder-854267-1-iscsi Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: machine: x86_64 Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: clock source: unix Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: pcre jit disabled Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: detected number of CPU cores: 4 Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: current working directory: / Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: detected binary path: /usr/bin/uwsgi-core Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: your processes number limit is 47680 Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: your memory page size is 4096 bytes Aug 24 05:43:39.865289 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: detected max file descriptor number: 2048 Aug 24 05:43:39.866607 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: lock engine: pthread robust mutexes Aug 24 05:43:39.866607 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: thunder lock: enabled Aug 24 05:43:39.866607 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 05:43:39.866607 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 05:43:39.907994 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: Python main interpreter initialized at 0x562b981d89c0 Aug 24 05:43:39.907994 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: python threads support enabled Aug 24 05:43:39.907994 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: your server socket listen backlog is limited to 100 connections Aug 24 05:43:39.907994 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: your mercy for graceful operations on workers is 90 seconds Aug 24 05:43:39.908427 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 05:43:39.908515 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: *** Operational MODE: preforking *** Aug 24 05:43:39.908771 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: *** uWSGI is running in multiple interpreter mode *** Aug 24 05:43:39.908771 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: spawned uWSGI master process (pid: 127739) Aug 24 05:43:39.908976 dv-cinder-854267-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 05:43:39.912141 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: spawned uWSGI worker 1 (pid: 127755, cores: 1) Aug 24 05:43:39.912509 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: spawned uWSGI worker 2 (pid: 127756, cores: 1) Aug 24 05:43:39.912724 dv-cinder-854267-1-iscsi devstack@n-api.service[127739]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 05:43:40.585575 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 05:43:40.599455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 05:43:41.749104 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:43:41.749104 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: from cryptography.utils import int_from_bytes Aug 24 05:43:41.749737 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:43:41.749737 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: from cryptography.utils import int_from_bytes Aug 24 05:43:41.817131 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:43:41.817131 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: from cryptography.utils import int_from_bytes Aug 24 05:43:41.817615 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:43:41.817615 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: from cryptography.utils import int_from_bytes Aug 24 05:43:44.206869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:43:44.207551 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:43:44.207667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:43:44.207992 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:43:44.208250 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:43:44.208678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.209014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.209852 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.210301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.210956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.211045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.211310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.211635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.211969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.212233 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.212579 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.212908 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854267-1-iscsi {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.213236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.213551 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.213868 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.214195 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.214503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.214829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.215152 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.215666 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.217784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.218364 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.218939 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.219552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.220116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.220705 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.221265 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.221778 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.222205 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.222615 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.224064 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854267-1-iscsi {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.224064 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.224064 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.224064 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.224558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.224886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.225780 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.226123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.226455 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.226775 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.227116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.227545 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.227878 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.228207 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.228547 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.228870 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.229186 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.229513 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.229822 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.230131 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.230389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.230701 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.231036 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.231362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.231692 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.231948 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.232204 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.232571 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.232899 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.233213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.233526 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.233852 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.234138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.234446 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.234751 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.235061 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.235367 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.235699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.236027 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.236339 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.236804 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.237006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.237437 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.237675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.237987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.238332 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.238640 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.238994 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.239454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.239787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.240101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.240601 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.240776 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.241480 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.241480 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.241739 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.241994 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.242301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.242668 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.242929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.243236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.243544 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.243887 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.244152 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.244496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.244807 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.245114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.245420 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.245731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.246043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.246348 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.246656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.246969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.247295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.247617 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.247921 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.248229 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.248573 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.248878 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.249202 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.249510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.249817 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.250140 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.250449 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.250759 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.251076 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.251389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.251688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.252005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.252306 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.252642 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.252961 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.253270 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.253576 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.253884 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.254186 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.254496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.254799 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.255107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.255409 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.255717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.256042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.256429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.256737 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.257123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.257546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.257869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.258232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.258562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.258907 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.259227 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.259561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.260055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.260216 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.260560 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.260876 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.261206 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.261521 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.261905 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.262239 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.262603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.262930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.263265 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.263597 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.263919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.264359 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.264708 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.265029 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.265362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.265696 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.266010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.266354 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.266702 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.267019 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.267345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.267677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.267988 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.268299 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.268643 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.268969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.269449 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.269614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.269952 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.270266 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.270732 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.271048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.271419 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.271734 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.272753 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.273587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.273757 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.274096 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.274464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.274968 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.275333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.275690 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.275958 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.276315 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.276651 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.276970 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.277276 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.277605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.277943 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.278253 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.278595 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.278905 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.279221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.279536 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.279850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.280163 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.280504 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.280822 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.281131 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.281462 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.281778 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.282086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.282411 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.282722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.283033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.283352 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.283666 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.283978 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.284288 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.284631 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.284961 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.285275 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.285590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.285931 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.286270 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.286575 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.286898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.287223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.288441 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.288565 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.288789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.289277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.289402 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.289712 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.290277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.290582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.290885 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.291188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.291491 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.291795 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.292123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.292452 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.292762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.293066 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.293370 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.294110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.294110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.294110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.294670 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.294986 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.295311 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.295624 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.295945 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.296266 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.296607 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.296921 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.297234 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.297561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.297873 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.298195 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.298503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.298895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.299221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.299594 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.299905 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.300235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.300612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.300950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.301267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.301591 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.301903 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.302220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.302531 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.302844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.304086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.304086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.304338 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.305451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.305451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.305451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.311904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.311904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.311904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.311904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.311904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.311904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.311904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.311904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.313107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.313107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.313107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.313107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.313107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.313107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.313627 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:43:44.314045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.314144 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:43:44.314240 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.314240 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.314412 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:43:44.314514 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.314610 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:43:44.314704 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.314788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:43:44.314871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.314975 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.315075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.315075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.315233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.315325 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.315417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.315508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.315605 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.315703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.315805 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.315900 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.315986 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.316069 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.316152 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.316244 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.316338 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.316602 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.316701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.316787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.316878 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.317026 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.317118 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.317203 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.317286 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854267-1-iscsi {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.317371 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.317521 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.317611 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.317696 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.317779 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.317872 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.317957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.318055 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.318142 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.318238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.318332 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.318418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.318502 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.318600 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.319356 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.319356 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.319640 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.319772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.319901 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.320024 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.320168 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.320268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.320354 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.320468 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.320567 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.320661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.320755 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.320903 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.321002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.321146 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.321252 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.321345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.321487 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.321578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.321719 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.321819 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.321914 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.321999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.322091 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.322181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854267-1-iscsi {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.322338 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.322444 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.322651 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.322759 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.322964 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.323059 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.323269 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.323373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.323580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.323682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.323900 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.323993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.324294 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.324506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.324647 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.324845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.324964 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.325165 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.325306 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.325489 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.325601 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.325810 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.325913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.326138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.326242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.326469 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.326571 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.326799 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.326904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.327113 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.327214 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.327434 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.327545 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.327742 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.327842 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.328046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.328146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.328299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.328420 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.328644 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.328738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.328971 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.329066 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.329277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.329384 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.329582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.329686 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.329857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.329961 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.330112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.330243 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.330436 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.330540 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.330761 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.330855 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.331064 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.331161 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.331371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.331472 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.331759 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.331892 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.332074 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.332181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.332379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.332538 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.332724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.332833 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.333035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.333128 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.333342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.333432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.333645 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.333747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.333950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.334042 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.334301 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.334407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.334614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.334829 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.334955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.335187 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.335343 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.335594 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.335701 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.335853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.335956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.336168 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.336269 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.336540 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.336657 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.336847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.336946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.337153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.337245 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.337458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.337564 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.337771 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.337874 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.338083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.338175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.338401 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.338537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.338714 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.338834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.339044 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.339388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.339704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.339872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.340019 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.340172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.340277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.340692 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.341022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.341336 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.341649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.341962 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.342266 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.342579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.342798 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.342956 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.343136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.343288 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.343479 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.343652 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.343811 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.343963 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.344107 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.344251 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.344464 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.344620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.344783 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.344928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.345081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.345225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.345368 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.345522 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.345745 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.345912 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.346010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.346228 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.346366 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.346532 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.346703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.346916 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.347058 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.347175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.347438 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.347531 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.347747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.347840 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.348056 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.348204 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.348384 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.348566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.348718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.348884 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.349015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.349198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.349344 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.349533 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.349655 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.349854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.350088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.350179 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.350353 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.350503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.350659 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.350797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.351031 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.351291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.351605 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.351755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.351938 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.352082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.352254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.352503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.352613 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.352846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.353160 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.353337 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.353469 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.353565 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.353779 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.353883 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.354085 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.354194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.354408 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.354510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.354736 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.354837 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.355049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.355152 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.355360 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.355454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.355672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.355832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.355987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:43:44.356133 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.356328 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.356508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.356692 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.356870 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.357044 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.357197 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.357369 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.357710 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.357875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.358047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.358213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.358359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.358467 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.358679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.358887 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.358993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.359220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.359316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.359628 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.359756 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.360014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.360117 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.360305 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.360501 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.360609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.360698 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.360913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.361017 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.361253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.361405 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.361576 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.361715 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.361902 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.362010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.362225 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.362343 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.362540 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.362652 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.362858 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.362952 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.363170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.363262 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.363491 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.363637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.363811 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.363938 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.364158 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.364262 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.364528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.364641 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.364853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.364989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.365163 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.365271 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.365487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.366119 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.366397 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.366886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.366982 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.367070 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.367156 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.367259 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.367398 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.367575 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.367740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.367838 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.368053 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.368162 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.368372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.368506 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.368711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.368823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.369028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.369192 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.369339 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.369433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.369655 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.369755 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.369973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.370076 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.370287 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.370393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.370599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.370700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.370916 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.371018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.371232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.371454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.371572 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.371700 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.371873 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.371970 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.372162 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.372263 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.372501 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.372625 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.372820 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.372951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.373127 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.373241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.373440 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.373748 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.373865 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.374117 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.374228 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.374435 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.374539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.374766 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.374906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.375085 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.375188 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.375400 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.375511 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.375713 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.375825 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.376030 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.376137 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.376348 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.376464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.376677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.376780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.377013 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.377122 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.377325 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.377429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.377644 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.377756 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.377962 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.378074 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.378275 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.378390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.378588 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.378691 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.378901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.379004 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.379212 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.379401 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.379532 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.379625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.379810 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.379912 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.380116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.380218 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.380471 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.380619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.380795 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.380932 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.381114 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.381836 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.382052 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.382260 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.382653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.382804 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.382924 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.383014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.383108 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.383396 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.383545 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.383731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.383869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.384072 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.384387 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.384512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.384755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.385086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.385418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.385730 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.386054 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.386379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.386718 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.386959 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.387128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.387330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.387491 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.387649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.387820 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.387987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.388142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.388287 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.388562 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.388722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.388824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.388993 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.389152 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.389249 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.389478 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.389632 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.389811 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.389959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.390131 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.390273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.390454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.390602 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.390771 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.390929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.391088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.391237 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.391404 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.391544 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.391740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.391858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.392062 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.392199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.392379 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.393503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.393503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.393765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.393890 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.393993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.394081 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.394166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.394264 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.394359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.394445 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.394538 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.394624 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.394717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.394804 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.394887 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.395120 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.395216 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.395437 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.395545 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.395768 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.395869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.396088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.396181 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.396456 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.396576 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.396793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.396893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.397103 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.397336 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.397424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.397534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.397719 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.397826 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.398029 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.398125 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.398340 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.398443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.398656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.398788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.398997 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.399107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.399304 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.399411 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.399627 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.399755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.399960 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.400069 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.400291 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.400387 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.400645 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.400753 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.400976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.401067 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.401305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.401413 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.401621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.401713 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.401940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.402031 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.402259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.402360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.402564 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.402664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.402871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.403019 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.403182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.403285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.403487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.403618 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.403795 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.403908 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.404101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.404194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.404442 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.404553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.404738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.404846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.405045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.405146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.405350 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.405444 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.405707 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.405814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.406016 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.406118 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.406347 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.406439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.406662 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.406760 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.406970 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.407073 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.407277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.407370 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.407585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.407688 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.407926 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.408019 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.408232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.408331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.408575 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.408660 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.408895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.409002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.409206 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.409301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.409526 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.409648 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.409840 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.409943 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.410160 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.410263 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.410476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.410576 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.410790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.410883 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.411105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.411206 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.411417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.411509 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.411727 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.411855 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.412036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.412140 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.412348 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.412617 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.412750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.412927 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.413052 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.413400 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.413519 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.413608 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.413743 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.413940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.414081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.414254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.414346 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.414579 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.414680 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.415159 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.415305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.415472 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.415591 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.415783 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.415910 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.416094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.416224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.416443 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.416764 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.417100 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.417299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.417454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.417636 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.417790 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.417961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.418135 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.418282 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.418436 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.418621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.418775 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.418939 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.419171 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.419331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.419553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.419702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.419857 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.420025 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.420171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.420324 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.420528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.420685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.420831 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.420983 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.421136 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.421297 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.421443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.421595 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.421740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.421893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.422056 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.422216 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.422370 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.422524 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.422669 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.422813 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.422957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.423110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.423256 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.423401 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.423554 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.423699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.423853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.424009 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.424164 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.424317 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.424496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.424654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.424939 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.425093 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.425279 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.425441 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.425587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.425728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.425917 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.426133 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.426285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.426453 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.426605 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.426789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.426943 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.427118 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.427277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.427446 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.427598 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.427756 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.427916 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.428742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.428944 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.429111 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.429496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.429657 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.429804 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.429949 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.430103 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.430256 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.430409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.430554 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.430718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.430872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.431028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.431185 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.431337 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.431482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.431626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.431770 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.431928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.432075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.432219 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.432369 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.432558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.432558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.432844 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.433006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.433161 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.433306 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.433458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.433616 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.433772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.433925 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.434077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.434231 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.434385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.434531 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.434675 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.434820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.434976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.435129 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.435289 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.435436 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.435580 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.435732 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.435884 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.436044 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.436190 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.436334 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.436500 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.436657 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.436802 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.436968 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.437113 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.437307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.437465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.437612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.437757 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.437914 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.438061 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.438206 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.438348 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.438500 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.438654 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.438809 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.438963 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.439116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.439267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.439504 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.439672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.439818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.439972 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.440127 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.440272 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.440455 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.440696 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.440847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.441050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.441221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.441368 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.441521 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.441675 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.441828 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.441972 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.442124 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.442277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.442429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.442584 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.442729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.442881 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.443045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.443190 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.443350 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.443494 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.443749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.444434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.444737 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.444911 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.445074 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.445234 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.445396 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.445548 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.445699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.445699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.446011 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.446163 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.446313 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.446472 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.446625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.446783 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.446949 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.447117 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.447117 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.447414 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.447566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.447726 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.447726 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.448033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.448192 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.448343 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.448521 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.448686 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.448840 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.448840 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.449135 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.449284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.449434 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.449699 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.449869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.450029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.450189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.450189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.450484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.450645 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.450816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.450816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.451121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.451121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.451423 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.451576 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.451728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.451728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.452033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.452033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.452344 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.452344 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.452684 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.452843 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.453005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.453165 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.453331 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.453493 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.453654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.453807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.453807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.454113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.454113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.454401 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.454551 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.454702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.454862 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.455023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.455023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.455310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.455462 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.455612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.455784 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.456046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.456215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.456374 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.456550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.456703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.456867 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.457030 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.457182 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.457341 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.457494 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.457655 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.457823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.457996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.458157 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.458316 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.458468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.458619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.458788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.458950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.459110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.459301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.459464 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.459616 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.459884 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.460056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.460220 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.460386 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.460637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.460818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.460972 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.461124 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.461284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.461437 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.461601 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.461763 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.461916 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.462068 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.462240 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.462392 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.462552 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.462714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.462867 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.463026 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.463189 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.463355 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.463516 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.463679 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.463840 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.464003 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.464163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.464163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.464512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.464669 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.464821 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.464982 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.465140 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.465292 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.465458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.465611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.465770 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.465770 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.466059 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.466059 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.466375 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.466535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.466688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.466688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.466984 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.467135 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.467301 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.467463 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.467615 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.467777 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.467929 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.468090 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.468261 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.468484 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.468645 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.468797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.468948 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.469114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.469267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.469426 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.469578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.469729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.469905 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.470150 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.470316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.470492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.470645 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.470815 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.470968 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.471203 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.471203 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.471512 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.471664 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.471814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.471979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.472132 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.472284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.472477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.472637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.472797 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.472964 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.473116 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.473268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.473418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.473578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.473730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.473900 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.474065 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.474219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.474371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.474532 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.474685 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.474685 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.475049 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.475375 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.475538 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.475839 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.476010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.476171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.476324 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.476583 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.476737 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.476737 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.477058 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.477223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.477385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.477552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.477704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.477856 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.478016 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.478169 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.478320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.478480 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.478640 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.478792 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.478970 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.479133 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.479286 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.479438 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.479588 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.479754 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.479915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.480075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.480326 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.480503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.480656 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.480822 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.480994 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.481174 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.481327 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.481479 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.481639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.481807 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.481960 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.482112 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.482112 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.482406 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.482578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.482731 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.482890 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.483061 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.483221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.483374 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.483534 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.483687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.483848 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.484009 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.484170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.484331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.484519 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.484673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.484833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.484992 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.485157 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.485323 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.485485 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.485637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.485801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.485954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.486294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.486468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.486632 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.486793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.486954 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.487106 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.487259 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.487433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.487597 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.487749 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.487902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.488054 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.488214 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.488382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.489147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.489311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.489464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.489614 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.489779 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.489951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.490113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:43:44.490274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.490274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.490274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.490274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.490274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.490274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.490274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.490274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.492084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.492084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.492084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.492084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.492084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.493057 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.493057 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.493057 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.493493 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.493644 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.493945 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.494357 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.494716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.494934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.495270 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.495599 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.495924 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.496256 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.496594 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.496906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.497223 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.497533 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.497845 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.498153 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.498470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.498779 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.499094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.499403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.499723 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.500031 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.500357 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.500714 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.501031 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.501342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.501653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.502005 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.502316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.502653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.502972 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.503303 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.503625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.503946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.504268 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.504672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.504941 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.505228 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.505549 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.505866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.506242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.507228 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.507579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.508157 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.508594 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.508923 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.509247 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.509568 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.509890 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.510209 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.510528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.510850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.511172 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.511491 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.511827 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.512160 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.512516 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.512862 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.513193 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.513518 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.513840 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.514161 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.514530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.514872 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.515160 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.515458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.515781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.516102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.516571 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.516778 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.517061 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.517380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.517701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.517701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.517701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.517701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.517701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.517701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.517701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.517701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.521505 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.521505 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.521505 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.521505 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.522171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.522324 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.522558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.522885 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.523216 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.523556 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.523871 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.524291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.524530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.524937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.525237 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.525530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.525794 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.526107 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.526436 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.526754 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.527388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.527747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.528070 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.528422 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.528757 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.529081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.529395 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.529729 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.530047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.530362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.530686 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.531101 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.531324 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.531634 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.531958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.532267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.532619 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.532940 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.533254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.533586 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.533898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.534208 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.534518 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.534834 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.535159 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.535438 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.535746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.536054 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.536371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.536702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.537018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.537326 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.538336 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.538735 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.539058 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.539369 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.539701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.540271 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.540739 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.541077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.541396 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.541729 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.542049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.542364 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.542724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.543049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.543626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.543972 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.544300 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.544671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.545012 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.545355 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.545638 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.545930 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.546264 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.546583 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.546900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.547217 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.547824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.548144 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.549043 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.549371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.549693 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.550013 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.550333 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.550491 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO dbcounter [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Registered counter for database nova_api Aug 24 05:43:44.550657 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.550965 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.551285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.551603 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.551930 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.552313 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.552630 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.553114 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.554006 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.554338 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.554658 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.554975 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.555286 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.555604 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.555929 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.556268 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.556617 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.556935 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.557373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.557693 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.558023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.558351 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.558673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.559001 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.559329 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.559696 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.559963 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.560282 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.560643 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.560996 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.561333 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.561667 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.561977 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.562288 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.562598 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.562915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.563240 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.563555 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.563862 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.564171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.564527 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.564818 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.565128 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.565436 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.565745 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.566063 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.566367 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.566675 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.567002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.567275 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.567578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.567878 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.568458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.569578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.569578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.570166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.570166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.573441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.573441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.573441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.573441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.573441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.573441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.573441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.573441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.574328 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.574328 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.574328 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.574328 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.574923 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.574923 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.575274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.575440 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.575987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_db.sqlalchemy.engines [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:43:44.576317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.576317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.576317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.576985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.576985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.577284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.577613 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.577836 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.578198 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.578627 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.578808 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.579132 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.579445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.580196 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.580196 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.580560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.580727 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.581033 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.581349 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.581664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.581985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.582309 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.582854 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.583362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writer thread running {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:43:44.583761 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.583761 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.584080 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.584366 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.584688 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.585012 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.585368 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.585704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.586077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.586385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.586642 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:43:44.586891 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:43:44.642218 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.context [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8836218-39fb-4108-99ef-4bb0f27daef8(cell1) {{(pid=127756) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 05:43:44.646364 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:43:44.647083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:43:44.649017 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:43:44.649778 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:43:44.650228 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:43:44.652256 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:43:44.654321 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO dbcounter [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Registered counter for database nova_cell0 Aug 24 05:43:44.657687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO dbcounter [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Registered counter for database nova_api Aug 24 05:43:44.658489 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO dbcounter [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Registered counter for database nova_cell1 Aug 24 05:43:44.666615 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_db.sqlalchemy.engines [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:43:44.670228 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_db.sqlalchemy.engines [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:43:44.675744 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writer thread running {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:43:44.681076 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_db.sqlalchemy.engines [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:43:44.682351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writer thread running {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:43:44.687777 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writer thread running {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:43:44.745102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.context [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8836218-39fb-4108-99ef-4bb0f27daef8(cell1) {{(pid=127755) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 05:43:44.749124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:43:44.749886 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:43:44.751491 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:43:44.752234 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:43:44.752712 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:43:44.754739 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:43:44.757622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO dbcounter [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Registered counter for database nova_cell0 Aug 24 05:43:44.761740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO dbcounter [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Registered counter for database nova_cell1 Aug 24 05:43:44.769138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_db.sqlalchemy.engines [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:43:44.771667 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_db.sqlalchemy.engines [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:43:44.779500 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writer thread running {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:43:44.780792 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writer thread running {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:43:44.831502 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO dbcounter [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Registered counter for database nova_cell0 Aug 24 05:43:44.838959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_db.sqlalchemy.engines [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:43:44.843489 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writer thread running {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:43:44.933625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO dbcounter [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Registered counter for database nova_cell0 Aug 24 05:43:44.942395 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_db.sqlalchemy.engines [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:43:44.947368 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writer thread running {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:43:45.182439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: WARNING keystonemiddleware.auth_token [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:43:45.189940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: WARNING keystonemiddleware.auth_token [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:43:45.294560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: WARNING keystonemiddleware.auth_token [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:43:45.302615 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: WARNING keystonemiddleware.auth_token [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:43:45.548246 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: WARNING keystonemiddleware.auth_token [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:43:45.555733 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: WARNING keystonemiddleware.auth_token [None req-d8f106aa-503b-4a50-97ab-80181b1d337a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:43:45.561842 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562b981d89c0 pid: 127756 (default app) Aug 24 05:43:45.662553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: WARNING keystonemiddleware.auth_token [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:43:45.669045 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: WARNING keystonemiddleware.auth_token [None req-28450543-f9e8-4984-b11c-0086bd34664b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:43:45.674484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562b981d89c0 pid: 127755 (default app) Aug 24 05:44:20.501154 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=3 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:20.503665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=3 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:20.504654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=3 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:20.509081 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=3 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:21.282569 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2e9478cb-6c76-4d0d-a305-a533e90133bd tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] Action: 'create', calling method: .version_select at 0x7f065e09d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-739499416", "metadata": {"Type": "work"}}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:23.954287 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2e9478cb-6c76-4d0d-a305-a533e90133bd tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.467153 Aug 24 05:44:23.962785 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 24 05:44:20 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3470 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 05:44:23.976107 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:23.977307 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:23.978122 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:23.978845 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:24.203320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b0eb2247-a9a9-4599-9aeb-2206d983262a tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] Calling method '.version_select at 0x7f065e0e8160>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:25.219603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-703c9953-2947-48ef-932f-2bbafe50f346 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Action: 'create', calling method: .version_select at 0x7f065df6f4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1358070545"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:26.253224 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b0eb2247-a9a9-4599-9aeb-2206d983262a tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c1d40cad-fb52-450d-aa6f-0d8e29653762" status: 200 len: 353 microversion: 2.1 time: 2.282283 Aug 24 05:44:26.254838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 1/2] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:23 2022] GET /compute/v2.1/os-volumes/c1d40cad-fb52-450d-aa6f-0d8e29653762 => generated 353 bytes in 2285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:26.269163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-148dafab-a901-4823-b539-cd3ff9adf38d tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] Calling method '.version_select at 0x7f065dfaf4c0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:26.315502 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-703c9953-2947-48ef-932f-2bbafe50f346 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.749190 Aug 24 05:44:26.316919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 2/3] 10.222.0.15 () {60 vars in 1155 bytes} [Wed Aug 24 05:44:24 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1751 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 05:44:26.341490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3c424710-be91-46b1-ae4b-54e45a5e762e tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065df85700>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:26.408077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-148dafab-a901-4823-b539-cd3ff9adf38d tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c1d40cad-fb52-450d-aa6f-0d8e29653762" status: 200 len: 353 microversion: 2.1 time: 0.143994 Aug 24 05:44:26.409279 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:26 2022] GET /compute/v2.1/os-volumes/c1d40cad-fb52-450d-aa6f-0d8e29653762 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:44:26.429048 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-480180dc-8b75-46b4-9acc-ddeedee31aef tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] Calling method '.version_select at 0x7f065dfafb80>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:26.487110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3c424710-be91-46b1-ae4b-54e45a5e762e tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 200 len: 345 microversion: 2.1 time: 0.151082 Aug 24 05:44:26.835787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:26 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:44:26.860722 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-480180dc-8b75-46b4-9acc-ddeedee31aef tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/c1d40cad-fb52-450d-aa6f-0d8e29653762" status: 202 len: 0 microversion: 2.1 time: 0.437162 Aug 24 05:44:26.861541 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 24 05:44:26 2022] DELETE /compute/v2.1/os-volumes/c1d40cad-fb52-450d-aa6f-0d8e29653762 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:44:26.883992 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bf83470f-f69f-414e-a748-a952e289308c tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] Calling method '.version_select at 0x7f065df85dc0>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:27.039980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bf83470f-f69f-414e-a748-a952e289308c tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c1d40cad-fb52-450d-aa6f-0d8e29653762" status: 200 len: 352 microversion: 2.1 time: 0.157779 Aug 24 05:44:27.039980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:26 2022] GET /compute/v2.1/os-volumes/c1d40cad-fb52-450d-aa6f-0d8e29653762 => generated 352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:27.507787 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f9f26b04-11a5-40e5-bd58-1470b205c80b tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065df69280>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:27.637281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f9f26b04-11a5-40e5-bd58-1470b205c80b tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 200 len: 346 microversion: 2.1 time: 0.137533 Aug 24 05:44:27.652454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:27 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:27.666325 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2b4dfcde-8c30-4fa0-bb6a-a4061e1566a1 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Action: 'create', calling method: .version_select at 0x7f065df85af0>, body: {"snapshot": {"volume_id": "b5d98ac5-af4d-462e-ba10-996d5992767e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1840020500"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:28.056392 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a6ea08ae-8188-4a14-8092-a3b581592604 tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] Calling method '.version_select at 0x7f065dfafc10>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:29.274535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-a6ea08ae-8188-4a14-8092-a3b581592604 tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] HTTP exception thrown: Volume c1d40cad-fb52-450d-aa6f-0d8e29653762 could not be found. Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a6ea08ae-8188-4a14-8092-a3b581592604 tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] Request method failure captured: Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/os-volumes/c1d40cad-fb52-450d-aa6f-0d8e29653762 HTTP/1.1 Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbq00BoVa36zHNJ9ugvuhAHiLxRIyRjVUa2gds4cEhwDoSmOFFzUB_Ep-oLCh8xDbqSZrGb3pHLQHSRp2Y7aTC2zFr_szBX9k0EhDnTnywd_np3HYKvBcD14LnpH-gb3JtV_vNyyr9-qwDojK03wI1I6S3MLVthvLLrdnI7tgaQ1YXI Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 69d11893b9624f6bbf8c8eeda08d4858 Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-VolumesGetTestJSON-1933600884 Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:44:29.295981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_69d11893b9624f6bbf8c8eeda08d4858"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69d11893b9624f6bbf8c8eeda08d4858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/69d11893b9624f6bbf8c8eeda08d4858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/69d11893b9624f6bbf8c8eeda08d4858"}]}] Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-VolumesGetTestJSON-1933600884 Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 69d11893b9624f6bbf8c8eeda08d4858 Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-VolumesGetTestJSON-1933600884 Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-VolumesGetTestJSON-1933600884-project Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: e9cd9823dd8b4195b6f782b8cf391a07 Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-VolumesGetTestJSON-1933600884-project Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Volume c1d40cad-fb52-450d-aa6f-0d8e29653762 could not be found. Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': 'c1d40cad-fb52-450d-aa6f-0d8e29653762'} Aug 24 05:44:29.298029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1d40cad-fb52-450d-aa6f-0d8e29653762 could not be found. (HTTP 404) (Request-ID: req-5ab176eb-9599-4afc-bcad-9f83bb08a80c) Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:29.299427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:44:29.301221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1d40cad-fb52-450d-aa6f-0d8e29653762 could not be found. Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 05:44:29.302934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:44:29.306361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1d40cad-fb52-450d-aa6f-0d8e29653762 could not be found. Aug 24 05:44:29.306361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:29.306361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:29.306361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:29.306361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:29.306361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:44:29.306361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:44:29.306361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:44:29.306361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:44:29.306361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1d40cad-fb52-450d-aa6f-0d8e29653762 could not be found. Aug 24 05:44:29.306361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:29.319181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a6ea08ae-8188-4a14-8092-a3b581592604 tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] Returning 404 to user: Volume c1d40cad-fb52-450d-aa6f-0d8e29653762 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:44:29.319181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a6ea08ae-8188-4a14-8092-a3b581592604 tempest-VolumesGetTestJSON-1933600884 tempest-VolumesGetTestJSON-1933600884-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c1d40cad-fb52-450d-aa6f-0d8e29653762" status: 404 len: 109 microversion: 2.1 time: 1.261987 Aug 24 05:44:29.322848 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:28 2022] GET /compute/v2.1/os-volumes/c1d40cad-fb52-450d-aa6f-0d8e29653762 => generated 109 bytes in 1276 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:44:29.566566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2b4dfcde-8c30-4fa0-bb6a-a4061e1566a1 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.905699 Aug 24 05:44:29.574056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 5/10] 10.222.0.15 () {60 vars in 1162 bytes} [Wed Aug 24 05:44:27 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:29.594139 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-58d79940-324f-484f-96ff-917cddc3c9b3 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065e9474c0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:31.507396 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-58d79940-324f-484f-96ff-917cddc3c9b3 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd" status: 200 len: 287 microversion: 2.1 time: 1.931364 Aug 24 05:44:31.508709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 24 05:44:29 2022] GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd => generated 287 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:44:31.523762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8dd90867-c407-424b-b0d1-00ca59915e4e tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065df6faf0>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:32.006456 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8dd90867-c407-424b-b0d1-00ca59915e4e tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.487399 Aug 24 05:44:32.007035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1140 bytes} [Wed Aug 24 05:44:31 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:44:32.025574 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-644fdc67-8d84-40c6-a55d-114763a596ec tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065dfafd30>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:32.168609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-644fdc67-8d84-40c6-a55d-114763a596ec tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd" status: 200 len: 287 microversion: 2.1 time: 0.137925 Aug 24 05:44:32.168609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 24 05:44:32 2022] GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd => generated 287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:44:33.209838 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a0a44aaf-7387-4b74-ad7c-890941616c97 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065df6f3a0>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:33.318530 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a0a44aaf-7387-4b74-ad7c-890941616c97 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd" status: 200 len: 287 microversion: 2.1 time: 0.143668 Aug 24 05:44:33.319466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 7/14] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 24 05:44:33 2022] GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:34.338799 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9edd6ba4-7aec-4cec-9c1a-0ed10bde2ed8 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065df62430>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:34.419213 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9edd6ba4-7aec-4cec-9c1a-0ed10bde2ed8 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd" status: 200 len: 287 microversion: 2.1 time: 0.091225 Aug 24 05:44:34.419759 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 24 05:44:34 2022] GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:35.433653 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4b4f4b46-f8d0-40eb-adca-671dd72b90c9 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065df6fdc0>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:35.497097 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4b4f4b46-f8d0-40eb-adca-671dd72b90c9 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd" status: 200 len: 287 microversion: 2.1 time: 0.067410 Aug 24 05:44:35.505439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 24 05:44:35 2022] GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:36.512284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-72528811-d4dd-4e07-a024-cc22529beef2 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065df62af0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:36.579307 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-72528811-d4dd-4e07-a024-cc22529beef2 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd" status: 200 len: 287 microversion: 2.1 time: 0.072035 Aug 24 05:44:36.586276 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 9/17] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 24 05:44:36 2022] GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:37.249675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-48ca875c-816a-4250-9b9a-62ae7c681239 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: .version_select at 0x7f065df850d0>, body: {"keypair": {"name": "tempest-keypair-907806558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe/B5oHbZFruoptscHZPxbmF6ZYA/pjPft6ymxbx5mm7ahHwUDcDRp+c5RzJwnVQjMq4ECKyI4iyGgmCWxUihnw+qcAQARL1NGIDaNUVfC3xzlQUVo7WoVyJDMkx0ylfA=="}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:37.335055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-48ca875c-816a-4250-9b9a-62ae7c681239 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:44:37.343603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-48ca875c-816a-4250-9b9a-62ae7c681239 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for user d3e6e20d5cd44444b43b1e7abb240f8d and project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:44:37.560338 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-48ca875c-816a-4250-9b9a-62ae7c681239 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.507837 Aug 24 05:44:37.563158 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 9/18] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 24 05:44:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:37.593856 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ee9d237c-9e13-4b17-8ff5-f63b47378e37 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065df62790>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:37.652021 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ee9d237c-9e13-4b17-8ff5-f63b47378e37 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd" status: 200 len: 288 microversion: 2.1 time: 0.062448 Aug 24 05:44:37.653418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 10/19] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 24 05:44:37 2022] GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd => generated 288 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:37.672815 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4164045f-bbc7-402a-8fb6-ea6b7d053d5a tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065dee3a60>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:37.927310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4164045f-bbc7-402a-8fb6-ea6b7d053d5a tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd" status: 202 len: 0 microversion: 2.1 time: 0.260732 Aug 24 05:44:37.927310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 10/20] 10.222.0.15 () {58 vars in 1254 bytes} [Wed Aug 24 05:44:37 2022] DELETE /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:44:37.956140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-cd904226-7aa5-4d9d-8a5b-d1b57b145ac5 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065df620d0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:38.062969 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-cd904226-7aa5-4d9d-8a5b-d1b57b145ac5 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd" status: 200 len: 287 microversion: 2.1 time: 0.133852 Aug 24 05:44:38.063555 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 11/21] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 24 05:44:37 2022] GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd => generated 287 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:44:38.911481 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1155281785", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "networks": [{"uuid": "9869aa28-1fa1-4f63-9600-67d3a3503d05"}]}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:39.084154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9a615263-c733-485a-b479-71c995360a48 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065dfafaf0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:39.193734 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.network.neutron [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] validate_networks() for [('9869aa28-1fa1-4f63-9600-67d3a3503d05', None, None, None, None, None)] {{(pid=127756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:44:39.331290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-9a615263-c733-485a-b479-71c995360a48 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] HTTP exception thrown: Snapshot 42a0d611-9d99-4dae-9a57-4401674b7acd could not be found. Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9a615263-c733-485a-b479-71c995360a48 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Request method failure captured: Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd HTTP/1.1 Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbq45958ZoCQmfZ8fsTQ2p808cuUjy-a8JqpM8VWTRC_-PS0eXj-lnA6KLY-3C14PAWhYMAx3lkg55jS4xmUyTZswLQQDy1zvQP61tDqJmrJ02vrg_FxSGZhkR3OxDB0Rlld4qv8YSkxGnNiDy51cz_gkpZQ9huHBC_ytXMTHhsYsi4 Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 1f6545fe1acc4a73a766dd17cd26678a Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:44:39.338673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1f6545fe1acc4a73a766dd17cd26678a"}]}] Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 1f6545fe1acc4a73a766dd17cd26678a Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-VolumesSnapshotsTestJSON-232576083-project Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: 4638fb875c0e4afbad0695c561db3f53 Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-VolumesSnapshotsTestJSON-232576083-project Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Snapshot 42a0d611-9d99-4dae-9a57-4401674b7acd could not be found. Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '42a0d611-9d99-4dae-9a57-4401674b7acd'} Aug 24 05:44:39.341112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 42a0d611-9d99-4dae-9a57-4401674b7acd could not be found. (HTTP 404) (Request-ID: req-039e1c75-93df-4798-bdcd-223bf989edec) Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:39.342981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:44:39.344202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 42a0d611-9d99-4dae-9a57-4401674b7acd could not be found. Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 05:44:39.345434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 42a0d611-9d99-4dae-9a57-4401674b7acd could not be found. Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 42a0d611-9d99-4dae-9a57-4401674b7acd could not be found. Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9a615263-c733-485a-b479-71c995360a48 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Returning 404 to user: Snapshot 42a0d611-9d99-4dae-9a57-4401674b7acd could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9a615263-c733-485a-b479-71c995360a48 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd" status: 404 len: 111 microversion: 2.1 time: 0.267979 Aug 24 05:44:39.347110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 12/22] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 24 05:44:39 2022] GET /compute/v2.1/os-snapshots/42a0d611-9d99-4dae-9a57-4401674b7acd => generated 111 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:44:39.357194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8d99e1e7-0f90-418b-a6da-a2f17a001a04 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] Calling method '.version_select at 0x7f065df62280>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:40.492697 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8d99e1e7-0f90-418b-a6da-a2f17a001a04 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8f88b424-60fa-4d65-90ed-58a618bf8ef8" status: 200 len: 351 microversion: 2.1 time: 1.146150 Aug 24 05:44:40.493960 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 13/23] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:39 2022] GET /compute/v2.1/os-volumes/8f88b424-60fa-4d65-90ed-58a618bf8ef8 => generated 351 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:40.503516 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-32e9b4bc-83e2-4569-8ace-b6b6d448ec4a tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065df628b0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:41.179526 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-32e9b4bc-83e2-4569-8ace-b6b6d448ec4a tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 202 len: 0 microversion: 2.1 time: 0.681159 Aug 24 05:44:41.186701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 14/24] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 24 05:44:40 2022] DELETE /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:44:41.196035 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-016c4a58-0ce8-437c-bf0b-d3693da36d13 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065df69d30>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:41.384775 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Flavor limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:44:41.385841 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Image limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:44:41.393830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Flavor pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:44:41.401593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Image pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:44:41.401593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:44:41.456902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:41.457519 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:41.458387 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:41.479730 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:41.480235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:41.489050 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:41.585792 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Getting quotas for project eb377db175354cac93e5ff6579af3e3e. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:44:41.593839 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-016c4a58-0ce8-437c-bf0b-d3693da36d13 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 200 len: 345 microversion: 2.1 time: 0.405331 Aug 24 05:44:41.594830 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 15/25] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:41 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 345 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:41.598191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Getting quotas for user 9bda9f6f00c74112a54573c3905ad1bf and project eb377db175354cac93e5ff6579af3e3e. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:44:41.670598 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Going to run 1 instances... {{(pid=127756) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:44:41.678530 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:44:41.994817 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9ea5cf96-bd3a-445f-b9a9-f8c436e7496a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.718572 Aug 24 05:44:41.995934 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 11/26] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:44:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:44:42.015172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e3540e28-d035-4622-946b-12b22889434c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:42.015820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e3540e28-d035-4622-946b-12b22889434c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:42.258786 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1891640969", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:42.285681 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e3540e28-d035-4622-946b-12b22889434c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:42.318333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e3540e28-d035-4622-946b-12b22889434c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1215 microversion: 2.1 time: 0.308153 Aug 24 05:44:42.329924 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 12/27] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:42 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1215 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:42.536530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] validate_networks() for [('f5a09cc1-27f9-4801-826b-d1e4f52ed502', None, None, None, None, None)] {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:44:42.611626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b9d2396a-0c78-4f14-99da-b015608d5e21 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065d641940>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:42.806318 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b9d2396a-0c78-4f14-99da-b015608d5e21 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 200 len: 345 microversion: 2.1 time: 0.200049 Aug 24 05:44:42.809059 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 13/28] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:42 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 345 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:43.363238 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-67c2e219-cbcf-42ee-bd5e-2706b3b6dbb4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:43.365513 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-67c2e219-cbcf-42ee-bd5e-2706b3b6dbb4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:43.519280 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-67c2e219-cbcf-42ee-bd5e-2706b3b6dbb4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:43.546711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-67c2e219-cbcf-42ee-bd5e-2706b3b6dbb4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1215 microversion: 2.1 time: 0.189200 Aug 24 05:44:43.547923 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 14/29] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:43 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1215 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:44:43.829747 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-53238d2e-3938-4cd3-8aee-5fbb2c9a62d2 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065c5eaca0>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:43.879903 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:44:43.880471 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:44:43.880846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:44:43.881252 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:44:43.881743 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:44:43.919870 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:43.920714 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:43.923618 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:43.927092 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:43.927519 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:43.927937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:43.983188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-53238d2e-3938-4cd3-8aee-5fbb2c9a62d2 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 200 len: 345 microversion: 2.1 time: 0.163022 Aug 24 05:44:43.984028 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 15/30] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:43 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 345 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:44.013612 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Getting quotas for project 39a99050c88d48db851f437f68b65a58. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:44:44.031383 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Getting quotas for user 926115c2e54741e6a3aca02437309b8f and project 39a99050c88d48db851f437f68b65a58. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:44:44.065571 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:44:44.073551 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:44:44.352762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2119193119", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf3d5dbf-6bc3-460c-95aa-1bef35e2fd6f"}], "security_groups": [{"name": "tempest-securitygroup--770068798"}], "key_name": "tempest-keypair-907806558", "user_data": "}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:44.371790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b0b516f0-0c0e-4de8-800e-779272c0360a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.434541 Aug 24 05:44:44.377749 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 16/31] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:44:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:44:44.385453 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-44f01043-787b-419a-a090-9245740c1f10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:44.386088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-44f01043-787b-419a-a090-9245740c1f10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:44.531952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-44f01043-787b-419a-a090-9245740c1f10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:44.574321 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-44f01043-787b-419a-a090-9245740c1f10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1222 microversion: 2.1 time: 0.191665 Aug 24 05:44:44.577772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 17/32] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:44 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1222 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:44:44.592920 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-58fdc8c0-b9ef-4bc2-86b9-6a7c3d5e7631 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:44.595063 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-58fdc8c0-b9ef-4bc2-86b9-6a7c3d5e7631 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:44.673641 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.network.neutron [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] validate_networks() for [('cf3d5dbf-6bc3-460c-95aa-1bef35e2fd6f', None, None, None, None, None)] {{(pid=127756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:44:44.820455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-58fdc8c0-b9ef-4bc2-86b9-6a7c3d5e7631 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:44.842765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-58fdc8c0-b9ef-4bc2-86b9-6a7c3d5e7631 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1215 microversion: 2.1 time: 0.256790 Aug 24 05:44:44.843146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 18/33] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:44 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:44.862801 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1158171987", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:44.995948 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] validate_networks() for [('f5a09cc1-27f9-4801-826b-d1e4f52ed502', None, None, None, None, None)] {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:44:46.079345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Flavor limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:44:46.079931 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Image limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:44:46.080498 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Flavor pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:44:46.081387 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Image pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:44:46.082001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:44:46.093295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:46.094048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:46.094703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:46.095669 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:46.096510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:46.097181 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:46.131040 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:44:46.152098 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for user d3e6e20d5cd44444b43b1e7abb240f8d and project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:44:46.199847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Going to run 1 instances... {{(pid=127756) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:44:46.202551 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:44:46.203112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:44:46.203599 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:44:46.204116 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:44:46.204437 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:44:46.204747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:44:46.224279 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:46.224805 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:46.225255 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:46.225992 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:46.226456 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:46.226890 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:46.263343 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Getting quotas for project 39a99050c88d48db851f437f68b65a58. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:44:46.285848 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Getting quotas for user 926115c2e54741e6a3aca02437309b8f and project 39a99050c88d48db851f437f68b65a58. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:44:46.305385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:44:46.309173 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:44:46.485627 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6fbb7c41-7121-48d7-9290-7d7f847ed9fb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.137815 Aug 24 05:44:46.489666 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 16/34] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:44:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 05:44:46.528158 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-af2fca27-84bb-4cc0-a6c8-36ef0c38bf8a tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065c5f5f70>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:46.608578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1955effe-2fe3-4027-be38-de0e8379370e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.749147 Aug 24 05:44:46.621217 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 19/35] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:44:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:44:46.629316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ef09697e-7df0-45e1-9181-54417fee5111 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:46.658872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-af2fca27-84bb-4cc0-a6c8-36ef0c38bf8a tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 200 len: 345 microversion: 2.1 time: 0.168024 Aug 24 05:44:46.659449 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 17/36] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:46 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:46.669535 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4b4e4f2a-ec8d-4b25-bec8-a7636d614789 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:46.677780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ef09697e-7df0-45e1-9181-54417fee5111 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:46.684655 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4b4e4f2a-ec8d-4b25-bec8-a7636d614789 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:46.693015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef09697e-7df0-45e1-9181-54417fee5111 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:46.705571 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef09697e-7df0-45e1-9181-54417fee5111 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:46.706348 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef09697e-7df0-45e1-9181-54417fee5111 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:46.715231 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef09697e-7df0-45e1-9181-54417fee5111 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:46.715753 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef09697e-7df0-45e1-9181-54417fee5111 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:46.716211 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef09697e-7df0-45e1-9181-54417fee5111 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:46.811786 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4b4e4f2a-ec8d-4b25-bec8-a7636d614789 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:46.823750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4b4e4f2a-ec8d-4b25-bec8-a7636d614789 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1241 microversion: 2.1 time: 0.162415 Aug 24 05:44:46.825101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 18/37] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:46 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1241 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:46.846071 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-cba1b647-844c-42d5-9a87-62535d5aedf1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:46.849772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-cba1b647-844c-42d5-9a87-62535d5aedf1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:47.032788 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cba1b647-844c-42d5-9a87-62535d5aedf1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:47.047524 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-cba1b647-844c-42d5-9a87-62535d5aedf1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1222 microversion: 2.1 time: 0.220907 Aug 24 05:44:47.076234 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 19/38] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:46 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1222 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:47.174170 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ef09697e-7df0-45e1-9181-54417fee5111 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:47.189829 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ef09697e-7df0-45e1-9181-54417fee5111 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1219 microversion: 2.1 time: 0.566985 Aug 24 05:44:47.191022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 20/39] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:46 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1219 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:47.684871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-60bbde5b-b560-4097-9786-8fc3c2a9de60 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065d641310>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:47.849819 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-843b0d20-a835-4674-9fea-6a00830eac5e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:47.854925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-843b0d20-a835-4674-9fea-6a00830eac5e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:47.886998 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-60bbde5b-b560-4097-9786-8fc3c2a9de60 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 200 len: 345 microversion: 2.1 time: 0.207917 Aug 24 05:44:47.887673 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 20/40] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:47 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 345 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:47.994209 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-843b0d20-a835-4674-9fea-6a00830eac5e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:48.006671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-843b0d20-a835-4674-9fea-6a00830eac5e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1241 microversion: 2.1 time: 0.165081 Aug 24 05:44:48.011230 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 21/41] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:47 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1241 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:48.071364 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-25607acf-e064-4dcf-8ff4-a59b4118fb1c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:48.071876 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-25607acf-e064-4dcf-8ff4-a59b4118fb1c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:48.087879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25607acf-e064-4dcf-8ff4-a59b4118fb1c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:48.088432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25607acf-e064-4dcf-8ff4-a59b4118fb1c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:48.088894 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25607acf-e064-4dcf-8ff4-a59b4118fb1c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:48.089634 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25607acf-e064-4dcf-8ff4-a59b4118fb1c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:48.106024 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25607acf-e064-4dcf-8ff4-a59b4118fb1c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:48.106024 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25607acf-e064-4dcf-8ff4-a59b4118fb1c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:48.223316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9c0301e2-a264-4ba0-bf2d-72e1c3a616e4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:48.225170 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9c0301e2-a264-4ba0-bf2d-72e1c3a616e4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:48.245438 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c0301e2-a264-4ba0-bf2d-72e1c3a616e4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:48.246405 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c0301e2-a264-4ba0-bf2d-72e1c3a616e4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:48.247578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c0301e2-a264-4ba0-bf2d-72e1c3a616e4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:48.249274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c0301e2-a264-4ba0-bf2d-72e1c3a616e4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:48.249989 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c0301e2-a264-4ba0-bf2d-72e1c3a616e4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:48.250805 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c0301e2-a264-4ba0-bf2d-72e1c3a616e4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:48.296892 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-25607acf-e064-4dcf-8ff4-a59b4118fb1c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:48.310866 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-25607acf-e064-4dcf-8ff4-a59b4118fb1c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1226 microversion: 2.1 time: 0.244236 Aug 24 05:44:48.311734 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:48 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1226 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:48.344172 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9c0301e2-a264-4ba0-bf2d-72e1c3a616e4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:48.353441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9c0301e2-a264-4ba0-bf2d-72e1c3a616e4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1211 microversion: 2.1 time: 0.141943 Aug 24 05:44:48.354094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 22/43] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:48 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1211 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:48.901606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f6612236-68ee-45db-9740-abe25a8234d1 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065c5fcd30>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:48.960620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f6612236-68ee-45db-9740-abe25a8234d1 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 200 len: 345 microversion: 2.1 time: 0.063127 Aug 24 05:44:48.961280 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 22/44] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:48 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:44:49.034816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6fa0e04a-85cb-419f-9733-97d7e2318a2e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:49.036082 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6fa0e04a-85cb-419f-9733-97d7e2318a2e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:49.042867 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa0e04a-85cb-419f-9733-97d7e2318a2e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:49.043359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa0e04a-85cb-419f-9733-97d7e2318a2e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:49.043798 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa0e04a-85cb-419f-9733-97d7e2318a2e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:49.044620 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa0e04a-85cb-419f-9733-97d7e2318a2e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:49.045084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa0e04a-85cb-419f-9733-97d7e2318a2e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:49.045516 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa0e04a-85cb-419f-9733-97d7e2318a2e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:49.110160 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6fa0e04a-85cb-419f-9733-97d7e2318a2e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:49.118944 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6fa0e04a-85cb-419f-9733-97d7e2318a2e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1245 microversion: 2.1 time: 0.088313 Aug 24 05:44:49.119672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 23/45] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:49 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:49.333502 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e27ae3ee-851d-4afb-a997-1e9534c2a102 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:49.334130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e27ae3ee-851d-4afb-a997-1e9534c2a102 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:49.342236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e27ae3ee-851d-4afb-a997-1e9534c2a102 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:49.343106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e27ae3ee-851d-4afb-a997-1e9534c2a102 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:49.344009 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e27ae3ee-851d-4afb-a997-1e9534c2a102 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:49.345294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e27ae3ee-851d-4afb-a997-1e9534c2a102 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:49.348938 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e27ae3ee-851d-4afb-a997-1e9534c2a102 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:49.348938 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e27ae3ee-851d-4afb-a997-1e9534c2a102 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:49.390226 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-550ac350-e9e3-4d26-b162-d51ad8e50820 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:49.391291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-550ac350-e9e3-4d26-b162-d51ad8e50820 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:49.406684 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-550ac350-e9e3-4d26-b162-d51ad8e50820 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:49.407861 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-550ac350-e9e3-4d26-b162-d51ad8e50820 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:49.408309 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-550ac350-e9e3-4d26-b162-d51ad8e50820 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:49.409581 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-550ac350-e9e3-4d26-b162-d51ad8e50820 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:49.410972 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-550ac350-e9e3-4d26-b162-d51ad8e50820 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:49.418316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-550ac350-e9e3-4d26-b162-d51ad8e50820 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:49.460430 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e27ae3ee-851d-4afb-a997-1e9534c2a102 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:49.477513 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e27ae3ee-851d-4afb-a997-1e9534c2a102 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1226 microversion: 2.1 time: 0.148630 Aug 24 05:44:49.478821 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 23/46] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:49 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1226 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:49.495620 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-550ac350-e9e3-4d26-b162-d51ad8e50820 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:49.505412 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-550ac350-e9e3-4d26-b162-d51ad8e50820 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1211 microversion: 2.1 time: 0.121038 Aug 24 05:44:49.506013 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 24/47] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:49 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1211 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:49.975122 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b133b1a5-3ac7-441f-b192-26354bb6c18e tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065c576160>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:50.030126 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b133b1a5-3ac7-441f-b192-26354bb6c18e tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 200 len: 345 microversion: 2.1 time: 0.059040 Aug 24 05:44:50.030751 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:49 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:50.141608 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1e634c2d-29a6-40e8-895d-b9115733d007 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:50.142312 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1e634c2d-29a6-40e8-895d-b9115733d007 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:50.149297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e634c2d-29a6-40e8-895d-b9115733d007 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:50.149843 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e634c2d-29a6-40e8-895d-b9115733d007 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:50.150235 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e634c2d-29a6-40e8-895d-b9115733d007 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:50.151077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e634c2d-29a6-40e8-895d-b9115733d007 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:50.152567 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e634c2d-29a6-40e8-895d-b9115733d007 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:50.152567 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e634c2d-29a6-40e8-895d-b9115733d007 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:50.261961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1e634c2d-29a6-40e8-895d-b9115733d007 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:50.278983 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1e634c2d-29a6-40e8-895d-b9115733d007 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1245 microversion: 2.1 time: 0.141945 Aug 24 05:44:50.279807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 25/49] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:50 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1245 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:50.499844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c427a0e6-e9bc-46c9-8271-9033a2ea7dd2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:50.500729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c427a0e6-e9bc-46c9-8271-9033a2ea7dd2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:50.511747 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c427a0e6-e9bc-46c9-8271-9033a2ea7dd2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:50.512987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c427a0e6-e9bc-46c9-8271-9033a2ea7dd2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:50.513616 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c427a0e6-e9bc-46c9-8271-9033a2ea7dd2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:50.514432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c427a0e6-e9bc-46c9-8271-9033a2ea7dd2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:50.515135 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c427a0e6-e9bc-46c9-8271-9033a2ea7dd2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:50.515648 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c427a0e6-e9bc-46c9-8271-9033a2ea7dd2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:50.530342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9a03ae10-9395-4cf2-b147-364ceca7513f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:50.538281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9a03ae10-9395-4cf2-b147-364ceca7513f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:50.540198 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a03ae10-9395-4cf2-b147-364ceca7513f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:50.541092 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a03ae10-9395-4cf2-b147-364ceca7513f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:50.541874 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a03ae10-9395-4cf2-b147-364ceca7513f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:50.542931 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a03ae10-9395-4cf2-b147-364ceca7513f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:50.543485 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a03ae10-9395-4cf2-b147-364ceca7513f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:50.544009 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a03ae10-9395-4cf2-b147-364ceca7513f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:50.651677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c427a0e6-e9bc-46c9-8271-9033a2ea7dd2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:50.662984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c427a0e6-e9bc-46c9-8271-9033a2ea7dd2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1226 microversion: 2.1 time: 0.167481 Aug 24 05:44:50.663821 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 25/50] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:50 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1226 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:44:50.694781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9a03ae10-9395-4cf2-b147-364ceca7513f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:50.704214 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9a03ae10-9395-4cf2-b147-364ceca7513f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1211 microversion: 2.1 time: 0.180416 Aug 24 05:44:50.705205 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 26/51] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:50 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1211 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:51.052779 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-eda8b253-cf82-4d29-a5d1-7b35b46aa528 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065c576550>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:51.172051 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-eda8b253-cf82-4d29-a5d1-7b35b46aa528 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 200 len: 345 microversion: 2.1 time: 0.121608 Aug 24 05:44:51.179552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 26/52] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:51 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:51.312041 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9c73192f-08f5-4dfa-bf52-41e5028e0ae9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:51.313687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9c73192f-08f5-4dfa-bf52-41e5028e0ae9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:51.325982 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c73192f-08f5-4dfa-bf52-41e5028e0ae9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:51.326493 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c73192f-08f5-4dfa-bf52-41e5028e0ae9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:51.326940 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c73192f-08f5-4dfa-bf52-41e5028e0ae9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:51.327661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c73192f-08f5-4dfa-bf52-41e5028e0ae9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:51.328277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c73192f-08f5-4dfa-bf52-41e5028e0ae9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:51.328613 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9c73192f-08f5-4dfa-bf52-41e5028e0ae9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:51.446715 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9c73192f-08f5-4dfa-bf52-41e5028e0ae9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:51.455351 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9c73192f-08f5-4dfa-bf52-41e5028e0ae9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1293 microversion: 2.1 time: 0.147617 Aug 24 05:44:51.455996 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 27/53] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:51 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1293 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:44:51.688506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-58c33f79-6861-42fb-91fc-3eb7b506be85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:51.689128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-58c33f79-6861-42fb-91fc-3eb7b506be85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:51.695942 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58c33f79-6861-42fb-91fc-3eb7b506be85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:51.696512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58c33f79-6861-42fb-91fc-3eb7b506be85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:51.696966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58c33f79-6861-42fb-91fc-3eb7b506be85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:51.697681 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58c33f79-6861-42fb-91fc-3eb7b506be85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:51.698148 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58c33f79-6861-42fb-91fc-3eb7b506be85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:51.698584 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58c33f79-6861-42fb-91fc-3eb7b506be85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:51.743333 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f5d0586c-db16-489a-af5f-eef5eecefc7a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:51.744231 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f5d0586c-db16-489a-af5f-eef5eecefc7a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:51.750715 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d0586c-db16-489a-af5f-eef5eecefc7a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:51.751204 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d0586c-db16-489a-af5f-eef5eecefc7a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:51.751642 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d0586c-db16-489a-af5f-eef5eecefc7a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:51.752345 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d0586c-db16-489a-af5f-eef5eecefc7a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:51.752829 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d0586c-db16-489a-af5f-eef5eecefc7a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:51.753570 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d0586c-db16-489a-af5f-eef5eecefc7a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:51.774166 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-58c33f79-6861-42fb-91fc-3eb7b506be85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:51.779133 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-58c33f79-6861-42fb-91fc-3eb7b506be85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1274 microversion: 2.1 time: 0.094432 Aug 24 05:44:51.791508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 27/54] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:51 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:51.855311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f5d0586c-db16-489a-af5f-eef5eecefc7a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:51.865461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f5d0586c-db16-489a-af5f-eef5eecefc7a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1275 microversion: 2.1 time: 0.126069 Aug 24 05:44:51.866670 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 28/55] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:51 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:44:51.868031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4c3b9e96-39db-4bdb-ba13-2f8851b8f082 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] Calling method '.version_select at 0x7f065c569d30>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:51.931121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4c3b9e96-39db-4bdb-ba13-2f8851b8f082 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/6e65bd14-edb3-4801-9a84-c0cc52ba1205" status: 200 len: 350 microversion: 2.1 time: 0.067765 Aug 24 05:44:51.932460 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 28/56] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:51 2022] GET /compute/v2.1/os-volumes/6e65bd14-edb3-4801-9a84-c0cc52ba1205 => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:44:52.188682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-37a50c5d-3a2e-4e88-93fa-b76249a9001d tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065cd29310>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:52.294848 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-37a50c5d-3a2e-4e88-93fa-b76249a9001d tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 200 len: 345 microversion: 2.1 time: 0.110962 Aug 24 05:44:52.304101 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 29/57] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:52 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:52.485512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-070537d4-fc03-46ea-ab14-08a2191f0ad1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:52.499077 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-070537d4-fc03-46ea-ab14-08a2191f0ad1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:52.528609 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-070537d4-fc03-46ea-ab14-08a2191f0ad1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:52.528609 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-070537d4-fc03-46ea-ab14-08a2191f0ad1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:52.529022 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-070537d4-fc03-46ea-ab14-08a2191f0ad1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:52.529649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-070537d4-fc03-46ea-ab14-08a2191f0ad1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:52.530211 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-070537d4-fc03-46ea-ab14-08a2191f0ad1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:52.530662 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-070537d4-fc03-46ea-ab14-08a2191f0ad1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:52.677073 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-070537d4-fc03-46ea-ab14-08a2191f0ad1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:52.697435 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-070537d4-fc03-46ea-ab14-08a2191f0ad1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1301 microversion: 2.1 time: 0.221542 Aug 24 05:44:52.723501 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 29/58] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:52 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1301 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:52.801679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a7d208ef-3fe1-4770-bac2-d2bd1f7e13dd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:52.802514 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a7d208ef-3fe1-4770-bac2-d2bd1f7e13dd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:52.819627 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7d208ef-3fe1-4770-bac2-d2bd1f7e13dd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:52.824628 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7d208ef-3fe1-4770-bac2-d2bd1f7e13dd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:52.826017 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7d208ef-3fe1-4770-bac2-d2bd1f7e13dd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:52.827038 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7d208ef-3fe1-4770-bac2-d2bd1f7e13dd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:52.832706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7d208ef-3fe1-4770-bac2-d2bd1f7e13dd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:52.838595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7d208ef-3fe1-4770-bac2-d2bd1f7e13dd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:52.893103 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b0ffeba6-3fe3-4cba-bd89-368d4e32a9ab tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:52.893731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b0ffeba6-3fe3-4cba-bd89-368d4e32a9ab tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:52.914831 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0ffeba6-3fe3-4cba-bd89-368d4e32a9ab tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:52.915272 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0ffeba6-3fe3-4cba-bd89-368d4e32a9ab tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:52.915982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0ffeba6-3fe3-4cba-bd89-368d4e32a9ab tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:52.923022 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0ffeba6-3fe3-4cba-bd89-368d4e32a9ab tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:52.923568 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0ffeba6-3fe3-4cba-bd89-368d4e32a9ab tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:52.924027 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0ffeba6-3fe3-4cba-bd89-368d4e32a9ab tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:53.124048 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a7d208ef-3fe1-4770-bac2-d2bd1f7e13dd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:53.134466 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a7d208ef-3fe1-4770-bac2-d2bd1f7e13dd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1282 microversion: 2.1 time: 0.336794 Aug 24 05:44:53.139350 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:52 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1282 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:53.207635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b0ffeba6-3fe3-4cba-bd89-368d4e32a9ab tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:53.229212 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b0ffeba6-3fe3-4cba-bd89-368d4e32a9ab tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1273 microversion: 2.1 time: 0.340534 Aug 24 05:44:53.234395 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 30/60] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:52 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:53.313261 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b82492df-34cd-4603-8f00-340813608f76 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065cd09f70>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:53.374647 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-b82492df-34cd-4603-8f00-340813608f76 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] HTTP exception thrown: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b82492df-34cd-4603-8f00-340813608f76 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Request method failure captured: Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e HTTP/1.1 Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbq45958ZoCQmfZ8fsTQ2p808cuUjy-a8JqpM8VWTRC_-PS0eXj-lnA6KLY-3C14PAWhYMAx3lkg55jS4xmUyTZswLQQDy1zvQP61tDqJmrJ02vrg_FxSGZhkR3OxDB0Rlld4qv8YSkxGnNiDy51cz_gkpZQ9huHBC_ytXMTHhsYsi4 Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 1f6545fe1acc4a73a766dd17cd26678a Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:44:53.377987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1f6545fe1acc4a73a766dd17cd26678a"}]}] Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 1f6545fe1acc4a73a766dd17cd26678a Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-VolumesSnapshotsTestJSON-232576083-project Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: 4638fb875c0e4afbad0695c561db3f53 Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-VolumesSnapshotsTestJSON-232576083-project Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': 'b5d98ac5-af4d-462e-ba10-996d5992767e'} Aug 24 05:44:53.379895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. (HTTP 404) (Request-ID: req-8560b0c7-06a4-44c2-a565-a3fd49a66dd0) Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:53.380816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:44:53.384233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 05:44:53.386402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b82492df-34cd-4603-8f00-340813608f76 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Returning 404 to user: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b82492df-34cd-4603-8f00-340813608f76 tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 404 len: 109 microversion: 2.1 time: 0.075821 Aug 24 05:44:53.391443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 31/61] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:53 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:44:53.408749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-13cabb45-b5c4-4b0e-87c7-515a50a37afd tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065c555ca0>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:53.525291 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-13cabb45-b5c4-4b0e-87c7-515a50a37afd tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] HTTP exception thrown: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-13cabb45-b5c4-4b0e-87c7-515a50a37afd tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Request method failure captured: Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: DELETE /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e HTTP/1.1 Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbq45958ZoCQmfZ8fsTQ2p808cuUjy-a8JqpM8VWTRC_-PS0eXj-lnA6KLY-3C14PAWhYMAx3lkg55jS4xmUyTZswLQQDy1zvQP61tDqJmrJ02vrg_FxSGZhkR3OxDB0Rlld4qv8YSkxGnNiDy51cz_gkpZQ9huHBC_ytXMTHhsYsi4 Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 1f6545fe1acc4a73a766dd17cd26678a Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:44:53.530164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1f6545fe1acc4a73a766dd17cd26678a"}]}] Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 1f6545fe1acc4a73a766dd17cd26678a Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-VolumesSnapshotsTestJSON-232576083-project Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 4638fb875c0e4afbad0695c561db3f53 Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-VolumesSnapshotsTestJSON-232576083-project Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': 'b5d98ac5-af4d-462e-ba10-996d5992767e'} Aug 24 05:44:53.532323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. (HTTP 404) (Request-ID: req-7ea5be42-7e6b-4824-b5ab-a76ca7ed8dc4) Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:53.533599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:44:53.538037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 05:44:53.542001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-13cabb45-b5c4-4b0e-87c7-515a50a37afd tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Returning 404 to user: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:44:53.552974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-13cabb45-b5c4-4b0e-87c7-515a50a37afd tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 404 len: 109 microversion: 2.1 time: 0.128994 Aug 24 05:44:53.557715 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c188fda1-7601-4c7b-b863-bb063eee32bb tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Calling method '.version_select at 0x7f065ccb0d30>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:53.558229 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 31/62] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 24 05:44:53 2022] DELETE /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:44:53.742723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7ec643ba-f877-41e9-9917-a58d7135c970 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:53.743758 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7ec643ba-f877-41e9-9917-a58d7135c970 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:53.749305 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-c188fda1-7601-4c7b-b863-bb063eee32bb tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] HTTP exception thrown: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c188fda1-7601-4c7b-b863-bb063eee32bb tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Request method failure captured: Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e HTTP/1.1 Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbq45958ZoCQmfZ8fsTQ2p808cuUjy-a8JqpM8VWTRC_-PS0eXj-lnA6KLY-3C14PAWhYMAx3lkg55jS4xmUyTZswLQQDy1zvQP61tDqJmrJ02vrg_FxSGZhkR3OxDB0Rlld4qv8YSkxGnNiDy51cz_gkpZQ9huHBC_ytXMTHhsYsi4 Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 1f6545fe1acc4a73a766dd17cd26678a Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:44:53.751579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1f6545fe1acc4a73a766dd17cd26678a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1f6545fe1acc4a73a766dd17cd26678a"}]}] Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 1f6545fe1acc4a73a766dd17cd26678a Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-232576083 Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-VolumesSnapshotsTestJSON-232576083-project Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: 4638fb875c0e4afbad0695c561db3f53 Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-VolumesSnapshotsTestJSON-232576083-project Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': 'b5d98ac5-af4d-462e-ba10-996d5992767e'} Aug 24 05:44:53.755028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. (HTTP 404) (Request-ID: req-762b159b-5f6a-49df-a45c-54d628d27efb) Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:53.757238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:44:53.762515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 05:44:53.767661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c188fda1-7601-4c7b-b863-bb063eee32bb tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] Returning 404 to user: Volume b5d98ac5-af4d-462e-ba10-996d5992767e could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c188fda1-7601-4c7b-b863-bb063eee32bb tempest-VolumesSnapshotsTestJSON-232576083 tempest-VolumesSnapshotsTestJSON-232576083-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e" status: 404 len: 109 microversion: 2.1 time: 0.214881 Aug 24 05:44:53.772071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 32/63] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:53 2022] GET /compute/v2.1/os-volumes/b5d98ac5-af4d-462e-ba10-996d5992767e => generated 109 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:44:53.776844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec643ba-f877-41e9-9917-a58d7135c970 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:53.776844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec643ba-f877-41e9-9917-a58d7135c970 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:53.776844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec643ba-f877-41e9-9917-a58d7135c970 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:53.776844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec643ba-f877-41e9-9917-a58d7135c970 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:53.778119 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec643ba-f877-41e9-9917-a58d7135c970 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:53.778119 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec643ba-f877-41e9-9917-a58d7135c970 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:54.161022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-eb89e611-d767-4f72-bf21-89c04d768a53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:54.168677 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-eb89e611-d767-4f72-bf21-89c04d768a53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:54.174703 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb89e611-d767-4f72-bf21-89c04d768a53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:54.174703 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb89e611-d767-4f72-bf21-89c04d768a53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:54.175104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb89e611-d767-4f72-bf21-89c04d768a53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:54.179340 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb89e611-d767-4f72-bf21-89c04d768a53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:54.182591 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb89e611-d767-4f72-bf21-89c04d768a53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:54.183501 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb89e611-d767-4f72-bf21-89c04d768a53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:54.519376 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7ec643ba-f877-41e9-9917-a58d7135c970 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:54.546245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7ec643ba-f877-41e9-9917-a58d7135c970 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1299 microversion: 2.1 time: 0.794070 Aug 24 05:44:54.546245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 32/64] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:53 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1299 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:54.546245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8bd95b6d-e9c8-4993-baef-910497e93781 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:54.546245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8bd95b6d-e9c8-4993-baef-910497e93781 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:54.548516 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bd95b6d-e9c8-4993-baef-910497e93781 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:54.549305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bd95b6d-e9c8-4993-baef-910497e93781 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:54.551230 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bd95b6d-e9c8-4993-baef-910497e93781 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:54.553885 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bd95b6d-e9c8-4993-baef-910497e93781 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:54.554811 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bd95b6d-e9c8-4993-baef-910497e93781 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:54.555534 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bd95b6d-e9c8-4993-baef-910497e93781 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:54.632076 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-eb89e611-d767-4f72-bf21-89c04d768a53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:54.649598 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-eb89e611-d767-4f72-bf21-89c04d768a53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1280 microversion: 2.1 time: 0.494892 Aug 24 05:44:54.651241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 33/65] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:54 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1280 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:44:54.736579 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8bd95b6d-e9c8-4993-baef-910497e93781 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:54.752189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8bd95b6d-e9c8-4993-baef-910497e93781 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1273 microversion: 2.1 time: 0.218485 Aug 24 05:44:54.752189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 33/66] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:54 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1273 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:54.827437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6dc5bce0-018c-4c98-b88e-33de9582a8e6 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] Calling method '.version_select at 0x7f065d609700>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:55.061955 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6dc5bce0-018c-4c98-b88e-33de9582a8e6 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/93434a3c-eed8-42e6-83f1-c194790a6fae" status: 200 len: 350 microversion: 2.1 time: 0.237714 Aug 24 05:44:55.078156 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 34/67] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:44:54 2022] GET /compute/v2.1/os-volumes/93434a3c-eed8-42e6-83f1-c194790a6fae => generated 350 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:55.092195 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-32b57585-3b09-46e0-96a8-802f8d46d8b8 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] Calling method '.version_select at 0x7f065c4fa8b0>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:55.541170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-32b57585-3b09-46e0-96a8-802f8d46d8b8 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.456696 Aug 24 05:44:55.541170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 34/68] 10.222.0.15 () {58 vars in 1134 bytes} [Wed Aug 24 05:44:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:44:55.559204 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2fb6ff58-4396-47b1-9d48-79ba3eab2340 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] Calling method '.version_select at 0x7f065ccd8af0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:55.568980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-66d3c642-a149-4313-8b22-06dc96bfe568 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:55.569606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-66d3c642-a149-4313-8b22-06dc96bfe568 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:55.594262 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d3c642-a149-4313-8b22-06dc96bfe568 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:55.594767 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d3c642-a149-4313-8b22-06dc96bfe568 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:55.595217 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d3c642-a149-4313-8b22-06dc96bfe568 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:55.596002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d3c642-a149-4313-8b22-06dc96bfe568 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:55.596532 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d3c642-a149-4313-8b22-06dc96bfe568 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:55.597010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d3c642-a149-4313-8b22-06dc96bfe568 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:55.932895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2fb6ff58-4396-47b1-9d48-79ba3eab2340 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.378325 Aug 24 05:44:55.936816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 35/69] 10.222.0.15 () {58 vars in 1149 bytes} [Wed Aug 24 05:44:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:55.955245 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9cb83912-ec1f-428c-bca0-b3b2875de784 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:55.957728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9cb83912-ec1f-428c-bca0-b3b2875de784 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:55.974228 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cb83912-ec1f-428c-bca0-b3b2875de784 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:55.975675 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cb83912-ec1f-428c-bca0-b3b2875de784 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:55.976792 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cb83912-ec1f-428c-bca0-b3b2875de784 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:55.978731 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cb83912-ec1f-428c-bca0-b3b2875de784 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:55.979925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cb83912-ec1f-428c-bca0-b3b2875de784 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:55.981599 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cb83912-ec1f-428c-bca0-b3b2875de784 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:56.109930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=4 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:56.241989 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=4 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:56.283286 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9cb83912-ec1f-428c-bca0-b3b2875de784 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:56.298911 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9cb83912-ec1f-428c-bca0-b3b2875de784 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1280 microversion: 2.1 time: 0.363921 Aug 24 05:44:56.301100 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 36/70] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:55 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1280 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:56.332840 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b910b8f9-e8fd-4b8b-9867-f7e47a349ce0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:56.332840 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b910b8f9-e8fd-4b8b-9867-f7e47a349ce0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:56.361896 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b910b8f9-e8fd-4b8b-9867-f7e47a349ce0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:56.365124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b910b8f9-e8fd-4b8b-9867-f7e47a349ce0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:56.368476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b910b8f9-e8fd-4b8b-9867-f7e47a349ce0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:56.371880 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b910b8f9-e8fd-4b8b-9867-f7e47a349ce0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:56.373578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b910b8f9-e8fd-4b8b-9867-f7e47a349ce0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:56.379728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b910b8f9-e8fd-4b8b-9867-f7e47a349ce0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:56.466443 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66d3c642-a149-4313-8b22-06dc96bfe568 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:56.493675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-66d3c642-a149-4313-8b22-06dc96bfe568 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.929021 Aug 24 05:44:56.495238 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 35/71] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:55 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:56.506861 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-07f3ffc4-d359-428e-a69b-d10bb50f6a59 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] Calling method '.version_select at 0x7f065c4fa550>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:56.697130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-07f3ffc4-d359-428e-a69b-d10bb50f6a59 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.198012 Aug 24 05:44:56.699129 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 36/72] 10.222.0.15 () {58 vars in 1134 bytes} [Wed Aug 24 05:44:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:56.716577 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9184b13b-49ac-45a1-ad32-a4f9ff14354b tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] Calling method '.version_select at 0x7f065c555c10>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:56.759282 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b910b8f9-e8fd-4b8b-9867-f7e47a349ce0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:56.770918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b910b8f9-e8fd-4b8b-9867-f7e47a349ce0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.467551 Aug 24 05:44:56.771644 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 37/73] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:56 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:56.829781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9184b13b-49ac-45a1-ad32-a4f9ff14354b tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.112820 Aug 24 05:44:56.829781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 37/74] 10.222.0.15 () {58 vars in 1167 bytes} [Wed Aug 24 05:44:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:44:56.840222 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f5ed6034-b137-476e-9e80-cc5f02e4d29c tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] Calling method '.version_select at 0x7f065cd295e0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:57.071586 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f5ed6034-b137-476e-9e80-cc5f02e4d29c tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.235125 Aug 24 05:44:57.072626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 38/75] 10.222.0.15 () {58 vars in 1170 bytes} [Wed Aug 24 05:44:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:57.091809 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=24 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:57.099812 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e4c780a9-ad90-43d3-aa77-7b23b69493ba tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] Calling method '.version_select at 0x7f065c46a940>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:57.259109 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e4c780a9-ad90-43d3-aa77-7b23b69493ba tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.167172 Aug 24 05:44:57.260169 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 38/76] 10.222.0.15 () {58 vars in 1155 bytes} [Wed Aug 24 05:44:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:57.276362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6abd4e27-9371-45e2-8987-0f11fc5db585 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] Calling method '.version_select at 0x7f065ccb0430>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:57.353907 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6b7fac92-22e2-4b58-bb42-b51affeebe6a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:57.355490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6b7fac92-22e2-4b58-bb42-b51affeebe6a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:57.381537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b7fac92-22e2-4b58-bb42-b51affeebe6a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:57.382288 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b7fac92-22e2-4b58-bb42-b51affeebe6a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:57.383743 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b7fac92-22e2-4b58-bb42-b51affeebe6a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:57.385277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b7fac92-22e2-4b58-bb42-b51affeebe6a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:57.386886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b7fac92-22e2-4b58-bb42-b51affeebe6a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:57.388102 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b7fac92-22e2-4b58-bb42-b51affeebe6a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:57.422712 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6abd4e27-9371-45e2-8987-0f11fc5db585 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.150619 Aug 24 05:44:57.428279 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 39/77] 10.222.0.15 () {58 vars in 1188 bytes} [Wed Aug 24 05:44:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:57.446846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-af70d6fa-4301-4518-aec5-39f8f79f9e98 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] Calling method '.version_select at 0x7f065cc5caf0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:57.609288 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-af70d6fa-4301-4518-aec5-39f8f79f9e98 tempest-VolumesTestJSON-1045662303 tempest-VolumesTestJSON-1045662303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.169965 Aug 24 05:44:57.612590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 40/78] 10.222.0.15 () {58 vars in 1155 bytes} [Wed Aug 24 05:44:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:57.636711 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-26658a32-7f72-4ef6-8910-a8a875084429 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:57.637531 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-26658a32-7f72-4ef6-8910-a8a875084429 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:57.648070 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6b7fac92-22e2-4b58-bb42-b51affeebe6a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:57.661004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6b7fac92-22e2-4b58-bb42-b51affeebe6a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.316687 Aug 24 05:44:57.662221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 39/79] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:57 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:57.664679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26658a32-7f72-4ef6-8910-a8a875084429 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:57.665811 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26658a32-7f72-4ef6-8910-a8a875084429 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:57.666527 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26658a32-7f72-4ef6-8910-a8a875084429 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:57.667380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26658a32-7f72-4ef6-8910-a8a875084429 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:57.667961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26658a32-7f72-4ef6-8910-a8a875084429 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:57.668557 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26658a32-7f72-4ef6-8910-a8a875084429 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:57.793746 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ba3d6b17-e3f0-4740-81de-9905f68623c6 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:57.797312 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ba3d6b17-e3f0-4740-81de-9905f68623c6 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:57.806453 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba3d6b17-e3f0-4740-81de-9905f68623c6 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:57.809120 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba3d6b17-e3f0-4740-81de-9905f68623c6 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:57.809896 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba3d6b17-e3f0-4740-81de-9905f68623c6 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:57.810867 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba3d6b17-e3f0-4740-81de-9905f68623c6 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:57.812558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba3d6b17-e3f0-4740-81de-9905f68623c6 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:57.814293 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba3d6b17-e3f0-4740-81de-9905f68623c6 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:57.920713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-26658a32-7f72-4ef6-8910-a8a875084429 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:57.937758 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-26658a32-7f72-4ef6-8910-a8a875084429 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.310408 Aug 24 05:44:57.939097 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 41/80] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:57 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:58.153931 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ba3d6b17-e3f0-4740-81de-9905f68623c6 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:58.169211 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ba3d6b17-e3f0-4740-81de-9905f68623c6 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.380262 Aug 24 05:44:58.170487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 40/81] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:57 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:58.311142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=18 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:58.370114 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-eb81bc39-6631-4118-9d2c-e1bd63d2be19 req-55712042-384e-4668-9b2d-1c7b2ef8a2ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f94c1e2-6b5c-4d47-bb02-b4c49642dd15", "tag": "3fa886a1-f7b6-41b0-a537-6f9e71b1139c"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:58.392083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-eb81bc39-6631-4118-9d2c-e1bd63d2be19 req-55712042-384e-4668-9b2d-1c7b2ef8a2ef service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:58.392908 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-eb81bc39-6631-4118-9d2c-e1bd63d2be19 req-55712042-384e-4668-9b2d-1c7b2ef8a2ef service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:58.393635 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-eb81bc39-6631-4118-9d2c-e1bd63d2be19 req-55712042-384e-4668-9b2d-1c7b2ef8a2ef service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:58.434648 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-eb81bc39-6631-4118-9d2c-e1bd63d2be19 req-55712042-384e-4668-9b2d-1c7b2ef8a2ef service nova] Creating event network-changed:3fa886a1-f7b6-41b0-a537-6f9e71b1139c for instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 on hv-cinder-85426 Aug 24 05:44:58.435642 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-eb81bc39-6631-4118-9d2c-e1bd63d2be19 req-55712042-384e-4668-9b2d-1c7b2ef8a2ef service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127755) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 05:44:58.436142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-eb81bc39-6631-4118-9d2c-e1bd63d2be19 req-55712042-384e-4668-9b2d-1c7b2ef8a2ef service nova] Acquired lock "compute-rpcapi-router" {{(pid=127755) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 05:44:58.437717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0576e0d-ace0-45d9-bc30-f44dd12745cd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:58.438398 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0576e0d-ace0-45d9-bc30-f44dd12745cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:58.438976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0576e0d-ace0-45d9-bc30-f44dd12745cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:58.440215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0576e0d-ace0-45d9-bc30-f44dd12745cd None None] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:58.441768 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0576e0d-ace0-45d9-bc30-f44dd12745cd None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:58.452520 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0576e0d-ace0-45d9-bc30-f44dd12745cd None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:58.454928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.compute.rpcapi [None req-f0576e0d-ace0-45d9-bc30-f44dd12745cd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 05:44:58.456115 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0576e0d-ace0-45d9-bc30-f44dd12745cd None None] Releasing lock "compute-rpcapi-router" {{(pid=127755) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 05:44:58.485877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f0576e0d-ace0-45d9-bc30-f44dd12745cd None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171969 Aug 24 05:44:58.485877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 42/82] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:58.709139 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0374e9a5-5e1a-4d87-b7c2-d82b4ab09844 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:58.709139 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0374e9a5-5e1a-4d87-b7c2-d82b4ab09844 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:58.717017 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0374e9a5-5e1a-4d87-b7c2-d82b4ab09844 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:58.717888 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0374e9a5-5e1a-4d87-b7c2-d82b4ab09844 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:58.718439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0374e9a5-5e1a-4d87-b7c2-d82b4ab09844 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:58.719668 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0374e9a5-5e1a-4d87-b7c2-d82b4ab09844 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:58.720533 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0374e9a5-5e1a-4d87-b7c2-d82b4ab09844 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:58.721305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0374e9a5-5e1a-4d87-b7c2-d82b4ab09844 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:58.890725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0374e9a5-5e1a-4d87-b7c2-d82b4ab09844 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:58.902785 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0374e9a5-5e1a-4d87-b7c2-d82b4ab09844 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.206668 Aug 24 05:44:58.902785 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 41/83] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:58 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:58.975944 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-fccf3859-4cf3-4126-bc04-9f5ceb7713d2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:58.979432 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-fccf3859-4cf3-4126-bc04-9f5ceb7713d2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:58.989630 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fccf3859-4cf3-4126-bc04-9f5ceb7713d2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:58.990484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fccf3859-4cf3-4126-bc04-9f5ceb7713d2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:58.991429 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fccf3859-4cf3-4126-bc04-9f5ceb7713d2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:58.992806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fccf3859-4cf3-4126-bc04-9f5ceb7713d2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:58.993619 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fccf3859-4cf3-4126-bc04-9f5ceb7713d2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:58.994310 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fccf3859-4cf3-4126-bc04-9f5ceb7713d2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:59.234855 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fccf3859-4cf3-4126-bc04-9f5ceb7713d2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:59.252813 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5859ee0c-496c-421f-ab67-a6609f25fea9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:59.254553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5859ee0c-496c-421f-ab67-a6609f25fea9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:59.264285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-fccf3859-4cf3-4126-bc04-9f5ceb7713d2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.296906 Aug 24 05:44:59.265074 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 43/84] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:58 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:59.274766 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5859ee0c-496c-421f-ab67-a6609f25fea9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:59.276041 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5859ee0c-496c-421f-ab67-a6609f25fea9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:59.277158 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5859ee0c-496c-421f-ab67-a6609f25fea9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:59.278753 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5859ee0c-496c-421f-ab67-a6609f25fea9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:59.279600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5859ee0c-496c-421f-ab67-a6609f25fea9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:59.280381 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5859ee0c-496c-421f-ab67-a6609f25fea9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:59.552981 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5859ee0c-496c-421f-ab67-a6609f25fea9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:59.574296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5859ee0c-496c-421f-ab67-a6609f25fea9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.365796 Aug 24 05:44:59.575172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 42/85] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:59 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:59.932320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7b69960b-6e24-49cc-af6b-e918604faf50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:59.933505 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7b69960b-6e24-49cc-af6b-e918604faf50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:59.946719 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b69960b-6e24-49cc-af6b-e918604faf50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:59.947727 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b69960b-6e24-49cc-af6b-e918604faf50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:59.949108 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b69960b-6e24-49cc-af6b-e918604faf50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:59.951146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b69960b-6e24-49cc-af6b-e918604faf50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:59.952290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b69960b-6e24-49cc-af6b-e918604faf50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:59.953444 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b69960b-6e24-49cc-af6b-e918604faf50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:00.240927 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7b69960b-6e24-49cc-af6b-e918604faf50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:00.243633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7b69960b-6e24-49cc-af6b-e918604faf50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.321646 Aug 24 05:45:00.243633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 44/86] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:59 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:00.305434 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ab4ea730-2e27-448e-9593-205b1ba390b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:00.306240 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ab4ea730-2e27-448e-9593-205b1ba390b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:00.329864 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab4ea730-2e27-448e-9593-205b1ba390b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:00.330683 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab4ea730-2e27-448e-9593-205b1ba390b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:00.332018 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab4ea730-2e27-448e-9593-205b1ba390b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:00.333326 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab4ea730-2e27-448e-9593-205b1ba390b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:00.334094 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab4ea730-2e27-448e-9593-205b1ba390b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:00.334806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab4ea730-2e27-448e-9593-205b1ba390b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:00.497743 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-e1952b69-0a3c-46fb-9782-c166fbd7b6fc req-7aa531a0-3ffd-4391-a63a-e534fe394351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876be02b-9b39-4f01-9650-28904167d60f", "tag": "43f1d0e1-4b2c-4e2b-95d1-f3ec8ce75535"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:45:00.513452 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-e1952b69-0a3c-46fb-9782-c166fbd7b6fc req-7aa531a0-3ffd-4391-a63a-e534fe394351 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:00.514654 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-e1952b69-0a3c-46fb-9782-c166fbd7b6fc req-7aa531a0-3ffd-4391-a63a-e534fe394351 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:00.515313 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-e1952b69-0a3c-46fb-9782-c166fbd7b6fc req-7aa531a0-3ffd-4391-a63a-e534fe394351 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:00.520788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:00.529515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-e1952b69-0a3c-46fb-9782-c166fbd7b6fc req-7aa531a0-3ffd-4391-a63a-e534fe394351 service nova] Creating event network-changed:43f1d0e1-4b2c-4e2b-95d1-f3ec8ce75535 for instance 876be02b-9b39-4f01-9650-28904167d60f on hv-cinder-85426 Aug 24 05:45:00.538543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ab4ea730-2e27-448e-9593-205b1ba390b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:00.543843 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-e1952b69-0a3c-46fb-9782-c166fbd7b6fc req-7aa531a0-3ffd-4391-a63a-e534fe394351 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050250 Aug 24 05:45:00.547552 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 45/87] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:00.551717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ab4ea730-2e27-448e-9593-205b1ba390b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.253004 Aug 24 05:45:00.552436 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 43/88] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:00 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:00.621451 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-458dabf9-19b7-4907-826f-2b55ecdc0483 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:00.622249 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-458dabf9-19b7-4907-826f-2b55ecdc0483 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:00.633331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-458dabf9-19b7-4907-826f-2b55ecdc0483 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:00.634143 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-458dabf9-19b7-4907-826f-2b55ecdc0483 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:00.634889 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-458dabf9-19b7-4907-826f-2b55ecdc0483 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:00.635952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-458dabf9-19b7-4907-826f-2b55ecdc0483 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:00.636843 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-458dabf9-19b7-4907-826f-2b55ecdc0483 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:00.637665 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-458dabf9-19b7-4907-826f-2b55ecdc0483 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:00.844815 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-458dabf9-19b7-4907-826f-2b55ecdc0483 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:00.863331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-458dabf9-19b7-4907-826f-2b55ecdc0483 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.246802 Aug 24 05:45:00.864531 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 46/89] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:00 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:01.292611 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ea47800a-74b4-4e2a-bc71-778fb8220f52 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:01.293379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ea47800a-74b4-4e2a-bc71-778fb8220f52 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:01.302083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea47800a-74b4-4e2a-bc71-778fb8220f52 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:01.302580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea47800a-74b4-4e2a-bc71-778fb8220f52 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:01.303015 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea47800a-74b4-4e2a-bc71-778fb8220f52 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:01.303717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea47800a-74b4-4e2a-bc71-778fb8220f52 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:01.304171 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea47800a-74b4-4e2a-bc71-778fb8220f52 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:01.304663 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea47800a-74b4-4e2a-bc71-778fb8220f52 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:01.455722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ea47800a-74b4-4e2a-bc71-778fb8220f52 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:01.465027 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ea47800a-74b4-4e2a-bc71-778fb8220f52 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.177808 Aug 24 05:45:01.473444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 44/90] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:01 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:01.591055 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-84cefdd9-ef10-4ffc-9f9a-5638b53241cf tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:01.591594 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-84cefdd9-ef10-4ffc-9f9a-5638b53241cf tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:01.606364 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-84cefdd9-ef10-4ffc-9f9a-5638b53241cf tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:01.606883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-84cefdd9-ef10-4ffc-9f9a-5638b53241cf tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:01.607317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-84cefdd9-ef10-4ffc-9f9a-5638b53241cf tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:01.608070 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-84cefdd9-ef10-4ffc-9f9a-5638b53241cf tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:01.608603 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-84cefdd9-ef10-4ffc-9f9a-5638b53241cf tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:01.609027 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-84cefdd9-ef10-4ffc-9f9a-5638b53241cf tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:01.819705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-84cefdd9-ef10-4ffc-9f9a-5638b53241cf tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:01.850575 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-84cefdd9-ef10-4ffc-9f9a-5638b53241cf tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.264036 Aug 24 05:45:01.851183 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 47/91] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:01 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:01.898312 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b9849014-39e1-4d10-a85b-3be073635a78 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:01.898938 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b9849014-39e1-4d10-a85b-3be073635a78 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:01.902092 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:01.912201 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9849014-39e1-4d10-a85b-3be073635a78 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:01.912990 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9849014-39e1-4d10-a85b-3be073635a78 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:01.913450 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9849014-39e1-4d10-a85b-3be073635a78 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:01.914377 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9849014-39e1-4d10-a85b-3be073635a78 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:01.915832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9849014-39e1-4d10-a85b-3be073635a78 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:01.915832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9849014-39e1-4d10-a85b-3be073635a78 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:01.922447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=95 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:02.146752 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b9849014-39e1-4d10-a85b-3be073635a78 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:02.154827 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b9849014-39e1-4d10-a85b-3be073635a78 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.260960 Aug 24 05:45:02.155418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 45/92] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:01 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:02.491392 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6bfb6db0-ec56-4a9d-8d26-c277362d705e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:02.492060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6bfb6db0-ec56-4a9d-8d26-c277362d705e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:02.498777 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6bfb6db0-ec56-4a9d-8d26-c277362d705e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:02.499267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6bfb6db0-ec56-4a9d-8d26-c277362d705e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:02.499877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6bfb6db0-ec56-4a9d-8d26-c277362d705e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:02.500790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6bfb6db0-ec56-4a9d-8d26-c277362d705e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:02.501250 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6bfb6db0-ec56-4a9d-8d26-c277362d705e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:02.501676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6bfb6db0-ec56-4a9d-8d26-c277362d705e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:02.690177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6bfb6db0-ec56-4a9d-8d26-c277362d705e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:02.698852 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6bfb6db0-ec56-4a9d-8d26-c277362d705e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.212856 Aug 24 05:45:02.699390 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 48/93] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:02 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:02.880520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d42e9904-c04f-46f6-830c-06e205bb16df tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:02.881400 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d42e9904-c04f-46f6-830c-06e205bb16df tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:02.888725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d42e9904-c04f-46f6-830c-06e205bb16df tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:02.889132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d42e9904-c04f-46f6-830c-06e205bb16df tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:02.889619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d42e9904-c04f-46f6-830c-06e205bb16df tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:02.890391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d42e9904-c04f-46f6-830c-06e205bb16df tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:02.890845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d42e9904-c04f-46f6-830c-06e205bb16df tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:02.891265 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d42e9904-c04f-46f6-830c-06e205bb16df tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:03.047236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d42e9904-c04f-46f6-830c-06e205bb16df tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:03.059236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d42e9904-c04f-46f6-830c-06e205bb16df tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.183682 Aug 24 05:45:03.059956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 46/94] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:02 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:03.177883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4551ba9d-a9bd-4398-bdee-b905a9a02e2c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:03.179810 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4551ba9d-a9bd-4398-bdee-b905a9a02e2c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:03.185478 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4551ba9d-a9bd-4398-bdee-b905a9a02e2c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:03.186274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4551ba9d-a9bd-4398-bdee-b905a9a02e2c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:03.186706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4551ba9d-a9bd-4398-bdee-b905a9a02e2c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:03.187640 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4551ba9d-a9bd-4398-bdee-b905a9a02e2c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:03.188156 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4551ba9d-a9bd-4398-bdee-b905a9a02e2c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:03.188621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4551ba9d-a9bd-4398-bdee-b905a9a02e2c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:03.382856 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4551ba9d-a9bd-4398-bdee-b905a9a02e2c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:03.411198 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4551ba9d-a9bd-4398-bdee-b905a9a02e2c tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.233855 Aug 24 05:45:03.412318 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 49/95] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:03 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:03.723777 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bb335fb1-8544-4c43-872d-dad41645af78 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:03.725535 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bb335fb1-8544-4c43-872d-dad41645af78 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:03.741879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bb335fb1-8544-4c43-872d-dad41645af78 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:03.747424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bb335fb1-8544-4c43-872d-dad41645af78 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:03.747905 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bb335fb1-8544-4c43-872d-dad41645af78 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:03.748800 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bb335fb1-8544-4c43-872d-dad41645af78 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:03.749426 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bb335fb1-8544-4c43-872d-dad41645af78 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:03.749862 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bb335fb1-8544-4c43-872d-dad41645af78 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:03.995079 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bb335fb1-8544-4c43-872d-dad41645af78 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:04.015145 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bb335fb1-8544-4c43-872d-dad41645af78 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.296744 Aug 24 05:45:04.017004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 47/96] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:03 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:04.089492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8e9c6109-314c-4c7e-9622-aa7a89849da0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:04.089492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8e9c6109-314c-4c7e-9622-aa7a89849da0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:04.109621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e9c6109-314c-4c7e-9622-aa7a89849da0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:04.119465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e9c6109-314c-4c7e-9622-aa7a89849da0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:04.119465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e9c6109-314c-4c7e-9622-aa7a89849da0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:04.119465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e9c6109-314c-4c7e-9622-aa7a89849da0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:04.119465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e9c6109-314c-4c7e-9622-aa7a89849da0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:04.119924 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e9c6109-314c-4c7e-9622-aa7a89849da0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:04.495300 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8e9c6109-314c-4c7e-9622-aa7a89849da0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:04.495300 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8e9c6109-314c-4c7e-9622-aa7a89849da0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.248870 Aug 24 05:45:04.495300 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 50/97] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:04 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:04.496462 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3f832da9-48c6-4207-abcd-a85dea11af22 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:04.496462 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3f832da9-48c6-4207-abcd-a85dea11af22 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:04.496462 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3f832da9-48c6-4207-abcd-a85dea11af22 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:04.496462 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3f832da9-48c6-4207-abcd-a85dea11af22 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:04.496806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3f832da9-48c6-4207-abcd-a85dea11af22 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:04.496806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3f832da9-48c6-4207-abcd-a85dea11af22 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:04.496806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3f832da9-48c6-4207-abcd-a85dea11af22 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:04.496806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3f832da9-48c6-4207-abcd-a85dea11af22 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:04.688984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3f832da9-48c6-4207-abcd-a85dea11af22 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:04.698055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3f832da9-48c6-4207-abcd-a85dea11af22 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.265760 Aug 24 05:45:04.704205 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 48/98] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:04 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:05.043711 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1a3d9979-c9f1-4685-86b7-46c0a103b49a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:05.047530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1a3d9979-c9f1-4685-86b7-46c0a103b49a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:05.051251 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:05.068595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1a3d9979-c9f1-4685-86b7-46c0a103b49a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:05.069123 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1a3d9979-c9f1-4685-86b7-46c0a103b49a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:05.076558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1a3d9979-c9f1-4685-86b7-46c0a103b49a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:05.076558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1a3d9979-c9f1-4685-86b7-46c0a103b49a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:05.076558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1a3d9979-c9f1-4685-86b7-46c0a103b49a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:05.076558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1a3d9979-c9f1-4685-86b7-46c0a103b49a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:05.509217 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-678534b9-895e-48fe-9121-3a0d64b218b9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:05.509217 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-678534b9-895e-48fe-9121-3a0d64b218b9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:05.509217 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678534b9-895e-48fe-9121-3a0d64b218b9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:05.509217 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678534b9-895e-48fe-9121-3a0d64b218b9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:05.510216 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678534b9-895e-48fe-9121-3a0d64b218b9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:05.510216 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678534b9-895e-48fe-9121-3a0d64b218b9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:05.510216 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678534b9-895e-48fe-9121-3a0d64b218b9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:05.510216 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678534b9-895e-48fe-9121-3a0d64b218b9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:05.816569 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1a3d9979-c9f1-4685-86b7-46c0a103b49a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:05.826993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1a3d9979-c9f1-4685-86b7-46c0a103b49a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.792520 Aug 24 05:45:05.841702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 51/99] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:05 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:05.850809 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9ba3b342-ce16-4adc-ac18-3845e700c743 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:05.853410 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9ba3b342-ce16-4adc-ac18-3845e700c743 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:05.861217 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ba3b342-ce16-4adc-ac18-3845e700c743 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:05.861995 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ba3b342-ce16-4adc-ac18-3845e700c743 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:05.862557 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ba3b342-ce16-4adc-ac18-3845e700c743 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:05.863299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ba3b342-ce16-4adc-ac18-3845e700c743 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:05.863757 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ba3b342-ce16-4adc-ac18-3845e700c743 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:05.864191 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ba3b342-ce16-4adc-ac18-3845e700c743 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:06.269916 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-678534b9-895e-48fe-9121-3a0d64b218b9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:06.278092 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-678534b9-895e-48fe-9121-3a0d64b218b9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.925987 Aug 24 05:45:06.281841 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 49/100] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:05 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:06.499775 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9ba3b342-ce16-4adc-ac18-3845e700c743 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:06.510281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9ba3b342-ce16-4adc-ac18-3845e700c743 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.666342 Aug 24 05:45:06.521382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 52/101] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:05 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:06.855763 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c375bcc7-ca42-4bad-9a04-cdb939f7f2df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:06.857442 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c375bcc7-ca42-4bad-9a04-cdb939f7f2df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:06.867176 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c375bcc7-ca42-4bad-9a04-cdb939f7f2df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:06.868087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c375bcc7-ca42-4bad-9a04-cdb939f7f2df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:06.868850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c375bcc7-ca42-4bad-9a04-cdb939f7f2df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:06.869864 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c375bcc7-ca42-4bad-9a04-cdb939f7f2df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:06.870716 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c375bcc7-ca42-4bad-9a04-cdb939f7f2df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:06.871424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c375bcc7-ca42-4bad-9a04-cdb939f7f2df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:07.290741 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c375bcc7-ca42-4bad-9a04-cdb939f7f2df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:07.303192 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c375bcc7-ca42-4bad-9a04-cdb939f7f2df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.454039 Aug 24 05:45:07.303373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4f1871e3-45db-433d-9bc5-f138eab750d6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:07.303977 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4f1871e3-45db-433d-9bc5-f138eab750d6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:07.311544 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4f1871e3-45db-433d-9bc5-f138eab750d6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:07.312279 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4f1871e3-45db-433d-9bc5-f138eab750d6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:07.312886 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4f1871e3-45db-433d-9bc5-f138eab750d6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:07.314715 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4f1871e3-45db-433d-9bc5-f138eab750d6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:07.316126 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4f1871e3-45db-433d-9bc5-f138eab750d6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:07.316733 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4f1871e3-45db-433d-9bc5-f138eab750d6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:07.317566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 50/102] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:06 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:07.533833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a17a2783-45ca-4129-a775-5fc9819f7f07 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:07.534679 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a17a2783-45ca-4129-a775-5fc9819f7f07 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:07.543721 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a17a2783-45ca-4129-a775-5fc9819f7f07 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:07.544624 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a17a2783-45ca-4129-a775-5fc9819f7f07 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:07.545311 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a17a2783-45ca-4129-a775-5fc9819f7f07 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:07.546304 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a17a2783-45ca-4129-a775-5fc9819f7f07 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:07.547003 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a17a2783-45ca-4129-a775-5fc9819f7f07 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:07.547635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a17a2783-45ca-4129-a775-5fc9819f7f07 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:07.651974 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4f1871e3-45db-433d-9bc5-f138eab750d6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:07.666460 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4f1871e3-45db-433d-9bc5-f138eab750d6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.370736 Aug 24 05:45:07.684353 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 53/103] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:07 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:07.772490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a17a2783-45ca-4129-a775-5fc9819f7f07 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:07.783808 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a17a2783-45ca-4129-a775-5fc9819f7f07 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.254986 Aug 24 05:45:07.785699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 51/104] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:07 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:08.336039 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5a01c66d-2263-4ace-9ff9-171dddd10ec1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:08.340441 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5a01c66d-2263-4ace-9ff9-171dddd10ec1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:08.380026 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-c03572bc-a6c3-4c4b-a7b1-b6380a8cc2b9 req-03f0b798-bec5-4ef6-b11f-f9caa88b37e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e", "tag": "ac54fa94-5136-4f4f-9757-f1ec362eb68d"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:45:08.400835 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a01c66d-2263-4ace-9ff9-171dddd10ec1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:08.404058 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a01c66d-2263-4ace-9ff9-171dddd10ec1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:08.405087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a01c66d-2263-4ace-9ff9-171dddd10ec1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:08.412687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-c03572bc-a6c3-4c4b-a7b1-b6380a8cc2b9 req-03f0b798-bec5-4ef6-b11f-f9caa88b37e7 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:08.414606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a01c66d-2263-4ace-9ff9-171dddd10ec1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:08.416193 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a01c66d-2263-4ace-9ff9-171dddd10ec1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:08.417278 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a01c66d-2263-4ace-9ff9-171dddd10ec1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:08.425388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-c03572bc-a6c3-4c4b-a7b1-b6380a8cc2b9 req-03f0b798-bec5-4ef6-b11f-f9caa88b37e7 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:08.427604 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-c03572bc-a6c3-4c4b-a7b1-b6380a8cc2b9 req-03f0b798-bec5-4ef6-b11f-f9caa88b37e7 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:08.451740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-c03572bc-a6c3-4c4b-a7b1-b6380a8cc2b9 req-03f0b798-bec5-4ef6-b11f-f9caa88b37e7 service nova] Creating event network-changed:ac54fa94-5136-4f4f-9757-f1ec362eb68d for instance c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e on hv-cinder-85426 Aug 24 05:45:08.460082 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-c03572bc-a6c3-4c4b-a7b1-b6380a8cc2b9 req-03f0b798-bec5-4ef6-b11f-f9caa88b37e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282240 Aug 24 05:45:08.461064 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 54/105] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:08.687391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5a01c66d-2263-4ace-9ff9-171dddd10ec1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:08.695185 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8321a09c-6ae3-432d-8575-234854cef2a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:08.696231 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8321a09c-6ae3-432d-8575-234854cef2a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:08.699812 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:08.700311 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5a01c66d-2263-4ace-9ff9-171dddd10ec1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.371926 Aug 24 05:45:08.701714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 52/106] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:08 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:08.705237 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8321a09c-6ae3-432d-8575-234854cef2a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:08.705834 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8321a09c-6ae3-432d-8575-234854cef2a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:08.707104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8321a09c-6ae3-432d-8575-234854cef2a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:08.707893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8321a09c-6ae3-432d-8575-234854cef2a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:08.708509 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8321a09c-6ae3-432d-8575-234854cef2a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:08.709213 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8321a09c-6ae3-432d-8575-234854cef2a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:08.806223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8a82b530-cecf-48ad-ae52-1f850adea060 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:08.806837 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8a82b530-cecf-48ad-ae52-1f850adea060 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:08.813116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a82b530-cecf-48ad-ae52-1f850adea060 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:08.814074 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a82b530-cecf-48ad-ae52-1f850adea060 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:08.814659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a82b530-cecf-48ad-ae52-1f850adea060 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:08.816042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a82b530-cecf-48ad-ae52-1f850adea060 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:08.816666 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a82b530-cecf-48ad-ae52-1f850adea060 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:08.817221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a82b530-cecf-48ad-ae52-1f850adea060 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:09.009872 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8321a09c-6ae3-432d-8575-234854cef2a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:09.019877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8321a09c-6ae3-432d-8575-234854cef2a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.331599 Aug 24 05:45:09.020633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 55/107] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:08 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:09.054829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8a82b530-cecf-48ad-ae52-1f850adea060 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:09.067265 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8a82b530-cecf-48ad-ae52-1f850adea060 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.265522 Aug 24 05:45:09.069805 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 53/108] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:08 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:09.725181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d0e6ef9e-7f9c-4a8a-bb41-6e104dbf75ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:09.726329 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d0e6ef9e-7f9c-4a8a-bb41-6e104dbf75ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:09.734612 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0e6ef9e-7f9c-4a8a-bb41-6e104dbf75ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:09.735164 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0e6ef9e-7f9c-4a8a-bb41-6e104dbf75ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:09.735648 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0e6ef9e-7f9c-4a8a-bb41-6e104dbf75ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:09.736488 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0e6ef9e-7f9c-4a8a-bb41-6e104dbf75ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:09.737105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0e6ef9e-7f9c-4a8a-bb41-6e104dbf75ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:09.737860 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0e6ef9e-7f9c-4a8a-bb41-6e104dbf75ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:09.891583 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d0e6ef9e-7f9c-4a8a-bb41-6e104dbf75ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:09.900512 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d0e6ef9e-7f9c-4a8a-bb41-6e104dbf75ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.180552 Aug 24 05:45:09.901091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 56/109] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:09 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:10.048871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8dbedb0a-7539-406b-bc55-48ca17455630 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:10.048871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8dbedb0a-7539-406b-bc55-48ca17455630 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:10.053823 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dbedb0a-7539-406b-bc55-48ca17455630 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:10.054434 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dbedb0a-7539-406b-bc55-48ca17455630 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:10.055023 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dbedb0a-7539-406b-bc55-48ca17455630 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:10.055829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dbedb0a-7539-406b-bc55-48ca17455630 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:10.056412 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dbedb0a-7539-406b-bc55-48ca17455630 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:10.059368 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dbedb0a-7539-406b-bc55-48ca17455630 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:10.089248 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-44998edf-db4d-4a08-8b61-6daed1ff82d2 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:10.089859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-44998edf-db4d-4a08-8b61-6daed1ff82d2 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:10.096271 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44998edf-db4d-4a08-8b61-6daed1ff82d2 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:10.103297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44998edf-db4d-4a08-8b61-6daed1ff82d2 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:10.103297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44998edf-db4d-4a08-8b61-6daed1ff82d2 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:10.103297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44998edf-db4d-4a08-8b61-6daed1ff82d2 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:10.103297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44998edf-db4d-4a08-8b61-6daed1ff82d2 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:10.103682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44998edf-db4d-4a08-8b61-6daed1ff82d2 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:10.321902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8dbedb0a-7539-406b-bc55-48ca17455630 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:10.340454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8dbedb0a-7539-406b-bc55-48ca17455630 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.290771 Aug 24 05:45:10.340454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 54/110] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:10 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:10.378860 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-44998edf-db4d-4a08-8b61-6daed1ff82d2 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:10.387315 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-44998edf-db4d-4a08-8b61-6daed1ff82d2 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.301777 Aug 24 05:45:10.387904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 57/111] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:10 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:10.481465 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-85c69288-816d-47fe-9154-b272be20ad1e req-599b2c83-17fd-447a-9a72-cb0cdccb9a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ebc8e1-e92d-4891-9d63-7a24cb4f9536", "tag": "13810f52-c423-464f-b3c5-0aa15c6ac45a"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:45:10.512053 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-85c69288-816d-47fe-9154-b272be20ad1e req-599b2c83-17fd-447a-9a72-cb0cdccb9a24 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:10.513198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-85c69288-816d-47fe-9154-b272be20ad1e req-599b2c83-17fd-447a-9a72-cb0cdccb9a24 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:10.514081 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-85c69288-816d-47fe-9154-b272be20ad1e req-599b2c83-17fd-447a-9a72-cb0cdccb9a24 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:10.558498 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-85c69288-816d-47fe-9154-b272be20ad1e req-599b2c83-17fd-447a-9a72-cb0cdccb9a24 service nova] Creating event network-changed:13810f52-c423-464f-b3c5-0aa15c6ac45a for instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 on hv-cinder-85426 Aug 24 05:45:10.559661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-85c69288-816d-47fe-9154-b272be20ad1e req-599b2c83-17fd-447a-9a72-cb0cdccb9a24 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127756) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 05:45:10.560388 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-85c69288-816d-47fe-9154-b272be20ad1e req-599b2c83-17fd-447a-9a72-cb0cdccb9a24 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127756) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 05:45:10.563345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e98c4b7e-36b3-4c9d-8c76-beaaf9236be9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:10.564499 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e98c4b7e-36b3-4c9d-8c76-beaaf9236be9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:10.565479 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e98c4b7e-36b3-4c9d-8c76-beaaf9236be9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:10.567368 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e98c4b7e-36b3-4c9d-8c76-beaaf9236be9 None None] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:10.568391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e98c4b7e-36b3-4c9d-8c76-beaaf9236be9 None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:10.569408 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e98c4b7e-36b3-4c9d-8c76-beaaf9236be9 None None] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:10.590795 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.compute.rpcapi [None req-e98c4b7e-36b3-4c9d-8c76-beaaf9236be9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 05:45:10.594793 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e98c4b7e-36b3-4c9d-8c76-beaaf9236be9 None None] Releasing lock "compute-rpcapi-router" {{(pid=127756) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 05:45:10.629309 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e98c4b7e-36b3-4c9d-8c76-beaaf9236be9 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151592 Aug 24 05:45:10.631821 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 55/112] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:45:10.937610 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-433010ce-9fbc-4250-9ed7-4912b364c26a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:10.941184 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-433010ce-9fbc-4250-9ed7-4912b364c26a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:10.961402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-433010ce-9fbc-4250-9ed7-4912b364c26a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:10.961402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-433010ce-9fbc-4250-9ed7-4912b364c26a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:10.961402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-433010ce-9fbc-4250-9ed7-4912b364c26a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:10.961402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-433010ce-9fbc-4250-9ed7-4912b364c26a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:10.962007 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-433010ce-9fbc-4250-9ed7-4912b364c26a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:10.962007 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-433010ce-9fbc-4250-9ed7-4912b364c26a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:11.190695 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-433010ce-9fbc-4250-9ed7-4912b364c26a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:11.199960 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-433010ce-9fbc-4250-9ed7-4912b364c26a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.280359 Aug 24 05:45:11.200588 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 58/113] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:10 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:11.357997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-45be103d-da7a-4766-96bc-263bd7d83a51 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:11.358841 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-45be103d-da7a-4766-96bc-263bd7d83a51 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:11.366032 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45be103d-da7a-4766-96bc-263bd7d83a51 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:11.366522 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45be103d-da7a-4766-96bc-263bd7d83a51 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:11.366955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45be103d-da7a-4766-96bc-263bd7d83a51 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:11.367684 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45be103d-da7a-4766-96bc-263bd7d83a51 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:11.368137 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45be103d-da7a-4766-96bc-263bd7d83a51 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:11.368608 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45be103d-da7a-4766-96bc-263bd7d83a51 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:11.423511 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-da47bbc4-59d4-4643-921d-e5f6cbdc60dd tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:11.424440 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-da47bbc4-59d4-4643-921d-e5f6cbdc60dd tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:11.451221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-da47bbc4-59d4-4643-921d-e5f6cbdc60dd tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:11.451745 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-da47bbc4-59d4-4643-921d-e5f6cbdc60dd tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:11.455534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-da47bbc4-59d4-4643-921d-e5f6cbdc60dd tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:11.457151 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-da47bbc4-59d4-4643-921d-e5f6cbdc60dd tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:11.462184 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-da47bbc4-59d4-4643-921d-e5f6cbdc60dd tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:11.464951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-da47bbc4-59d4-4643-921d-e5f6cbdc60dd tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:11.618531 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-45be103d-da7a-4766-96bc-263bd7d83a51 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:11.635327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-45be103d-da7a-4766-96bc-263bd7d83a51 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.280119 Aug 24 05:45:11.648434 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 56/114] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:11 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:12.164547 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-da47bbc4-59d4-4643-921d-e5f6cbdc60dd tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:12.206769 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-da47bbc4-59d4-4643-921d-e5f6cbdc60dd tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.787857 Aug 24 05:45:12.221554 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 59/115] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:11 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:12.227188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5748515f-f799-40e8-addd-b894f4e05b6c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:12.227864 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5748515f-f799-40e8-addd-b894f4e05b6c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:12.247865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5748515f-f799-40e8-addd-b894f4e05b6c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:12.248462 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5748515f-f799-40e8-addd-b894f4e05b6c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:12.249116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5748515f-f799-40e8-addd-b894f4e05b6c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:12.250226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5748515f-f799-40e8-addd-b894f4e05b6c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:12.250937 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5748515f-f799-40e8-addd-b894f4e05b6c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:12.251604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5748515f-f799-40e8-addd-b894f4e05b6c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:12.670991 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b0ec5419-fc07-4a53-8ac0-caef149960d9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:12.670991 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b0ec5419-fc07-4a53-8ac0-caef149960d9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:12.679274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0ec5419-fc07-4a53-8ac0-caef149960d9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:12.679760 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0ec5419-fc07-4a53-8ac0-caef149960d9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:12.680216 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0ec5419-fc07-4a53-8ac0-caef149960d9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:12.682061 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0ec5419-fc07-4a53-8ac0-caef149960d9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:12.684239 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0ec5419-fc07-4a53-8ac0-caef149960d9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:12.686420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0ec5419-fc07-4a53-8ac0-caef149960d9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:12.730700 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5748515f-f799-40e8-addd-b894f4e05b6c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:12.751955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5748515f-f799-40e8-addd-b894f4e05b6c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.523425 Aug 24 05:45:12.752786 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 57/116] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:12 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:12.918204 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b0ec5419-fc07-4a53-8ac0-caef149960d9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:12.928220 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b0ec5419-fc07-4a53-8ac0-caef149960d9 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.263035 Aug 24 05:45:12.929038 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 60/117] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:12 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:13.242267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7e1f4459-f62b-426c-9f5d-fb9c8ad29cdb tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:13.244703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7e1f4459-f62b-426c-9f5d-fb9c8ad29cdb tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:13.251065 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7e1f4459-f62b-426c-9f5d-fb9c8ad29cdb tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:13.251557 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7e1f4459-f62b-426c-9f5d-fb9c8ad29cdb tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:13.251994 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7e1f4459-f62b-426c-9f5d-fb9c8ad29cdb tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:13.252796 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7e1f4459-f62b-426c-9f5d-fb9c8ad29cdb tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:13.253646 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7e1f4459-f62b-426c-9f5d-fb9c8ad29cdb tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:13.253761 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7e1f4459-f62b-426c-9f5d-fb9c8ad29cdb tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:13.423436 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7e1f4459-f62b-426c-9f5d-fb9c8ad29cdb tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:13.439225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7e1f4459-f62b-426c-9f5d-fb9c8ad29cdb tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.198261 Aug 24 05:45:13.440010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 58/118] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:13 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:13.774595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-62a6335a-a9ab-45c7-ada2-e259c935980d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:13.775217 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-62a6335a-a9ab-45c7-ada2-e259c935980d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:13.788087 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-62a6335a-a9ab-45c7-ada2-e259c935980d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:13.788785 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-62a6335a-a9ab-45c7-ada2-e259c935980d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:13.789428 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-62a6335a-a9ab-45c7-ada2-e259c935980d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:13.790931 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-62a6335a-a9ab-45c7-ada2-e259c935980d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:13.791375 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-62a6335a-a9ab-45c7-ada2-e259c935980d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:13.791947 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-62a6335a-a9ab-45c7-ada2-e259c935980d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:13.965892 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8b029da1-4882-40b7-8370-866a9a439c1b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:13.966678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8b029da1-4882-40b7-8370-866a9a439c1b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:13.980753 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8b029da1-4882-40b7-8370-866a9a439c1b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:13.988004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8b029da1-4882-40b7-8370-866a9a439c1b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:13.988771 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8b029da1-4882-40b7-8370-866a9a439c1b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:13.989713 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8b029da1-4882-40b7-8370-866a9a439c1b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:13.990404 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8b029da1-4882-40b7-8370-866a9a439c1b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:13.991025 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8b029da1-4882-40b7-8370-866a9a439c1b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:14.157900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-62a6335a-a9ab-45c7-ada2-e259c935980d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:14.167941 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-62a6335a-a9ab-45c7-ada2-e259c935980d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.399684 Aug 24 05:45:14.174063 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 61/119] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:13 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:14.226038 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8b029da1-4882-40b7-8370-866a9a439c1b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:14.236439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8b029da1-4882-40b7-8370-866a9a439c1b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.274556 Aug 24 05:45:14.237970 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 59/120] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:13 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:14.465979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7823b0ab-42a5-4837-95e5-9624aaf79fe5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:14.466536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7823b0ab-42a5-4837-95e5-9624aaf79fe5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:14.472854 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7823b0ab-42a5-4837-95e5-9624aaf79fe5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:14.473342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7823b0ab-42a5-4837-95e5-9624aaf79fe5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:14.473799 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7823b0ab-42a5-4837-95e5-9624aaf79fe5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:14.474500 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7823b0ab-42a5-4837-95e5-9624aaf79fe5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:14.474950 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7823b0ab-42a5-4837-95e5-9624aaf79fe5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:14.475376 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7823b0ab-42a5-4837-95e5-9624aaf79fe5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:14.686171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7823b0ab-42a5-4837-95e5-9624aaf79fe5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:14.707648 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7823b0ab-42a5-4837-95e5-9624aaf79fe5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.244331 Aug 24 05:45:14.728909 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 62/121] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:14 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:15.210818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e1b1375a-fe44-425e-ba72-c3914bf3d153 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:15.214141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e1b1375a-fe44-425e-ba72-c3914bf3d153 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:15.235887 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b1375a-fe44-425e-ba72-c3914bf3d153 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:15.236729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b1375a-fe44-425e-ba72-c3914bf3d153 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:15.239037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b1375a-fe44-425e-ba72-c3914bf3d153 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:15.240604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b1375a-fe44-425e-ba72-c3914bf3d153 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:15.241605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b1375a-fe44-425e-ba72-c3914bf3d153 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:15.242552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b1375a-fe44-425e-ba72-c3914bf3d153 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:15.264799 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-eddc7937-7ad9-475d-bcc1-dd027f4166f0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:15.266803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-eddc7937-7ad9-475d-bcc1-dd027f4166f0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:15.286434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eddc7937-7ad9-475d-bcc1-dd027f4166f0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:15.287261 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eddc7937-7ad9-475d-bcc1-dd027f4166f0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:15.287993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eddc7937-7ad9-475d-bcc1-dd027f4166f0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:15.289240 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eddc7937-7ad9-475d-bcc1-dd027f4166f0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:15.290003 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eddc7937-7ad9-475d-bcc1-dd027f4166f0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:15.291235 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eddc7937-7ad9-475d-bcc1-dd027f4166f0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:15.299298 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:15.513336 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e1b1375a-fe44-425e-ba72-c3914bf3d153 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:15.524181 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e1b1375a-fe44-425e-ba72-c3914bf3d153 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.334805 Aug 24 05:45:15.524831 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 60/122] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:15 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:15.543987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-eddc7937-7ad9-475d-bcc1-dd027f4166f0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:15.557406 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-eddc7937-7ad9-475d-bcc1-dd027f4166f0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.299275 Aug 24 05:45:15.558069 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 63/123] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:15 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:15.732381 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-72f251bc-c14c-419a-b6b2-5c4dfbb3aa8e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:15.733021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-72f251bc-c14c-419a-b6b2-5c4dfbb3aa8e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:15.746455 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f251bc-c14c-419a-b6b2-5c4dfbb3aa8e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:15.751421 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f251bc-c14c-419a-b6b2-5c4dfbb3aa8e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:15.751421 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f251bc-c14c-419a-b6b2-5c4dfbb3aa8e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:15.751421 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f251bc-c14c-419a-b6b2-5c4dfbb3aa8e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:15.751421 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f251bc-c14c-419a-b6b2-5c4dfbb3aa8e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:15.752166 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f251bc-c14c-419a-b6b2-5c4dfbb3aa8e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:15.937123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-72f251bc-c14c-419a-b6b2-5c4dfbb3aa8e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:15.952294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-72f251bc-c14c-419a-b6b2-5c4dfbb3aa8e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.223315 Aug 24 05:45:15.953609 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 61/124] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:15 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:16.552041 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0701f94a-2585-47e4-a8e8-82eac5c72c9e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:16.553020 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0701f94a-2585-47e4-a8e8-82eac5c72c9e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:16.565116 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0701f94a-2585-47e4-a8e8-82eac5c72c9e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:16.565116 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0701f94a-2585-47e4-a8e8-82eac5c72c9e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:16.565116 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0701f94a-2585-47e4-a8e8-82eac5c72c9e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:16.565116 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0701f94a-2585-47e4-a8e8-82eac5c72c9e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:16.566284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0701f94a-2585-47e4-a8e8-82eac5c72c9e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:16.566284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0701f94a-2585-47e4-a8e8-82eac5c72c9e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:16.583113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f18389dd-73cf-4420-b02e-438a53f6f093 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:16.583569 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f18389dd-73cf-4420-b02e-438a53f6f093 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:16.590700 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18389dd-73cf-4420-b02e-438a53f6f093 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:16.591213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18389dd-73cf-4420-b02e-438a53f6f093 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:16.601307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18389dd-73cf-4420-b02e-438a53f6f093 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:16.601307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18389dd-73cf-4420-b02e-438a53f6f093 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:16.601307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18389dd-73cf-4420-b02e-438a53f6f093 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:16.601307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18389dd-73cf-4420-b02e-438a53f6f093 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:16.601723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:16.786543 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0701f94a-2585-47e4-a8e8-82eac5c72c9e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:16.795273 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0701f94a-2585-47e4-a8e8-82eac5c72c9e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.251026 Aug 24 05:45:16.795853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 64/125] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:16 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:16.833694 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f18389dd-73cf-4420-b02e-438a53f6f093 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:16.841786 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f18389dd-73cf-4420-b02e-438a53f6f093 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.264617 Aug 24 05:45:16.842373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 62/126] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:16 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:16.990126 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-57436080-9928-4421-b32c-cd804d40fb88 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:16.991411 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-57436080-9928-4421-b32c-cd804d40fb88 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:16.998240 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57436080-9928-4421-b32c-cd804d40fb88 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:16.998799 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57436080-9928-4421-b32c-cd804d40fb88 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:16.999544 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57436080-9928-4421-b32c-cd804d40fb88 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:17.000377 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57436080-9928-4421-b32c-cd804d40fb88 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:17.000949 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57436080-9928-4421-b32c-cd804d40fb88 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:17.001476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57436080-9928-4421-b32c-cd804d40fb88 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:17.159010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-57436080-9928-4421-b32c-cd804d40fb88 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:17.167626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-57436080-9928-4421-b32c-cd804d40fb88 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.183837 Aug 24 05:45:17.168206 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 65/127] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:16 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:17.816333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8613d798-2a3f-45ff-bb92-0ec186543b92 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:17.817317 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8613d798-2a3f-45ff-bb92-0ec186543b92 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:17.827010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8613d798-2a3f-45ff-bb92-0ec186543b92 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:17.827557 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8613d798-2a3f-45ff-bb92-0ec186543b92 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:17.829624 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8613d798-2a3f-45ff-bb92-0ec186543b92 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:17.830358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8613d798-2a3f-45ff-bb92-0ec186543b92 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:17.831571 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8613d798-2a3f-45ff-bb92-0ec186543b92 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:17.832025 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8613d798-2a3f-45ff-bb92-0ec186543b92 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:17.863139 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-353da8ae-6b10-4ae6-962a-533bf5857d8b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:17.864072 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-353da8ae-6b10-4ae6-962a-533bf5857d8b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:17.870788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-353da8ae-6b10-4ae6-962a-533bf5857d8b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:17.871917 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-353da8ae-6b10-4ae6-962a-533bf5857d8b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:17.872696 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-353da8ae-6b10-4ae6-962a-533bf5857d8b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:17.873705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-353da8ae-6b10-4ae6-962a-533bf5857d8b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:17.874981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-353da8ae-6b10-4ae6-962a-533bf5857d8b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:17.875864 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-353da8ae-6b10-4ae6-962a-533bf5857d8b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:18.292833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8613d798-2a3f-45ff-bb92-0ec186543b92 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:18.306638 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8613d798-2a3f-45ff-bb92-0ec186543b92 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.495028 Aug 24 05:45:18.308572 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 63/128] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:17 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:18.316681 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8a33fcf0-8efe-413e-bd1d-fd9a1795a771 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:18.317961 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8a33fcf0-8efe-413e-bd1d-fd9a1795a771 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:18.326335 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-353da8ae-6b10-4ae6-962a-533bf5857d8b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:18.342529 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-353da8ae-6b10-4ae6-962a-533bf5857d8b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.480887 Aug 24 05:45:18.342529 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 66/129] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:17 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:18.353387 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a33fcf0-8efe-413e-bd1d-fd9a1795a771 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:18.353886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a33fcf0-8efe-413e-bd1d-fd9a1795a771 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:18.354322 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a33fcf0-8efe-413e-bd1d-fd9a1795a771 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:18.365338 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a33fcf0-8efe-413e-bd1d-fd9a1795a771 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:18.366083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a33fcf0-8efe-413e-bd1d-fd9a1795a771 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:18.366546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a33fcf0-8efe-413e-bd1d-fd9a1795a771 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:19.036463 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8a33fcf0-8efe-413e-bd1d-fd9a1795a771 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:19.046475 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8a33fcf0-8efe-413e-bd1d-fd9a1795a771 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.736446 Aug 24 05:45:19.047528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 64/130] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:18 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:19.347727 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-96482d44-34f3-46e4-b54f-ac0b51d87876 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:19.348772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-96482d44-34f3-46e4-b54f-ac0b51d87876 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:19.359801 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-96482d44-34f3-46e4-b54f-ac0b51d87876 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:19.360449 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-96482d44-34f3-46e4-b54f-ac0b51d87876 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:19.361077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-96482d44-34f3-46e4-b54f-ac0b51d87876 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:19.362801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a2543598-dd54-4378-8181-243157961808 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:19.363162 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-96482d44-34f3-46e4-b54f-ac0b51d87876 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:19.363835 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a2543598-dd54-4378-8181-243157961808 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:19.364115 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-96482d44-34f3-46e4-b54f-ac0b51d87876 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:19.365047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-96482d44-34f3-46e4-b54f-ac0b51d87876 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:19.370879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2543598-dd54-4378-8181-243157961808 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:19.371379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2543598-dd54-4378-8181-243157961808 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:19.371830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2543598-dd54-4378-8181-243157961808 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:19.372551 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2543598-dd54-4378-8181-243157961808 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:19.373010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2543598-dd54-4378-8181-243157961808 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:19.373446 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2543598-dd54-4378-8181-243157961808 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:19.618967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a2543598-dd54-4378-8181-243157961808 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:19.637771 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a2543598-dd54-4378-8181-243157961808 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.279273 Aug 24 05:45:19.639389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 65/131] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:19 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:19.687427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-96482d44-34f3-46e4-b54f-ac0b51d87876 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:19.698537 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-96482d44-34f3-46e4-b54f-ac0b51d87876 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.358110 Aug 24 05:45:19.699124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 67/132] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:19 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:20.071151 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5c6b17aa-72cf-4fbb-904d-4e501b5e2ca3 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:20.072577 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5c6b17aa-72cf-4fbb-904d-4e501b5e2ca3 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:20.080714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c6b17aa-72cf-4fbb-904d-4e501b5e2ca3 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:20.082293 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c6b17aa-72cf-4fbb-904d-4e501b5e2ca3 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:20.082980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c6b17aa-72cf-4fbb-904d-4e501b5e2ca3 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:20.083932 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c6b17aa-72cf-4fbb-904d-4e501b5e2ca3 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:20.084725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c6b17aa-72cf-4fbb-904d-4e501b5e2ca3 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:20.086594 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c6b17aa-72cf-4fbb-904d-4e501b5e2ca3 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:20.296640 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5c6b17aa-72cf-4fbb-904d-4e501b5e2ca3 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:20.331736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5c6b17aa-72cf-4fbb-904d-4e501b5e2ca3 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.265794 Aug 24 05:45:20.334218 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 66/133] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:20 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:20.619535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-788b3e33-fa53-47fa-8fe8-8e79b2cf2f5b req-7d59e74b-f0ab-4db6-aae5-126a89d789e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f94c1e2-6b5c-4d47-bb02-b4c49642dd15", "name": "network-vif-plugged", "status": "completed", "tag": "3fa886a1-f7b6-41b0-a537-6f9e71b1139c"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:45:20.630019 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-788b3e33-fa53-47fa-8fe8-8e79b2cf2f5b req-7d59e74b-f0ab-4db6-aae5-126a89d789e8 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:20.630489 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-788b3e33-fa53-47fa-8fe8-8e79b2cf2f5b req-7d59e74b-f0ab-4db6-aae5-126a89d789e8 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:20.630920 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-788b3e33-fa53-47fa-8fe8-8e79b2cf2f5b req-7d59e74b-f0ab-4db6-aae5-126a89d789e8 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:20.642886 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-788b3e33-fa53-47fa-8fe8-8e79b2cf2f5b req-7d59e74b-f0ab-4db6-aae5-126a89d789e8 service nova] Creating event network-vif-plugged:3fa886a1-f7b6-41b0-a537-6f9e71b1139c for instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 on hv-cinder-85426 Aug 24 05:45:20.649627 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-788b3e33-fa53-47fa-8fe8-8e79b2cf2f5b req-7d59e74b-f0ab-4db6-aae5-126a89d789e8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092924 Aug 24 05:45:20.650277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 68/134] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:20.662108 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fd69f766-940d-4ae5-ac63-fd692d1876cb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:20.662724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-fd69f766-940d-4ae5-ac63-fd692d1876cb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:20.664623 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:20.671310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd69f766-940d-4ae5-ac63-fd692d1876cb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:20.671310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd69f766-940d-4ae5-ac63-fd692d1876cb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:20.671310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd69f766-940d-4ae5-ac63-fd692d1876cb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:20.671310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd69f766-940d-4ae5-ac63-fd692d1876cb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:20.671823 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd69f766-940d-4ae5-ac63-fd692d1876cb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:20.672251 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd69f766-940d-4ae5-ac63-fd692d1876cb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:20.719814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-43058db6-da4c-4a88-832c-37683cabe0fa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:20.720664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-43058db6-da4c-4a88-832c-37683cabe0fa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:20.727831 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43058db6-da4c-4a88-832c-37683cabe0fa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:20.728317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43058db6-da4c-4a88-832c-37683cabe0fa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:20.728780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43058db6-da4c-4a88-832c-37683cabe0fa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:20.731496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43058db6-da4c-4a88-832c-37683cabe0fa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:20.731496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43058db6-da4c-4a88-832c-37683cabe0fa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:20.731496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43058db6-da4c-4a88-832c-37683cabe0fa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:20.909394 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-fd69f766-940d-4ae5-ac63-fd692d1876cb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:20.923309 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-fd69f766-940d-4ae5-ac63-fd692d1876cb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.265095 Aug 24 05:45:20.924979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 67/135] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:20 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:20.945633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-43058db6-da4c-4a88-832c-37683cabe0fa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:20.956728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-43058db6-da4c-4a88-832c-37683cabe0fa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.240191 Aug 24 05:45:20.957759 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 69/136] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:20 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:21.367507 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-44d24d64-adbf-4a60-b539-ab06d8248686 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:21.379588 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-44d24d64-adbf-4a60-b539-ab06d8248686 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:21.387765 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-44d24d64-adbf-4a60-b539-ab06d8248686 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:21.388267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-44d24d64-adbf-4a60-b539-ab06d8248686 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:21.391141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-44d24d64-adbf-4a60-b539-ab06d8248686 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:21.391141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-44d24d64-adbf-4a60-b539-ab06d8248686 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:21.391141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-44d24d64-adbf-4a60-b539-ab06d8248686 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:21.391141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-44d24d64-adbf-4a60-b539-ab06d8248686 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:21.555226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-44d24d64-adbf-4a60-b539-ab06d8248686 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:21.564358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-44d24d64-adbf-4a60-b539-ab06d8248686 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.204001 Aug 24 05:45:21.565741 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 68/137] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:21 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:21.952742 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-04917fdd-f5d9-4e5f-b7ff-aee5e05180c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:21.952742 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-04917fdd-f5d9-4e5f-b7ff-aee5e05180c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:21.960978 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04917fdd-f5d9-4e5f-b7ff-aee5e05180c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:21.962211 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04917fdd-f5d9-4e5f-b7ff-aee5e05180c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:21.962703 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04917fdd-f5d9-4e5f-b7ff-aee5e05180c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:21.963431 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04917fdd-f5d9-4e5f-b7ff-aee5e05180c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:21.963909 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04917fdd-f5d9-4e5f-b7ff-aee5e05180c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:21.964559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04917fdd-f5d9-4e5f-b7ff-aee5e05180c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:21.992372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c73e33dd-7dc4-48b1-bc12-f3255240abd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:21.992372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c73e33dd-7dc4-48b1-bc12-f3255240abd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:21.999281 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c73e33dd-7dc4-48b1-bc12-f3255240abd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:22.000189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c73e33dd-7dc4-48b1-bc12-f3255240abd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:22.001257 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c73e33dd-7dc4-48b1-bc12-f3255240abd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:22.003937 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c73e33dd-7dc4-48b1-bc12-f3255240abd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:22.005085 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c73e33dd-7dc4-48b1-bc12-f3255240abd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:22.005812 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c73e33dd-7dc4-48b1-bc12-f3255240abd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:22.323458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-04917fdd-f5d9-4e5f-b7ff-aee5e05180c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:22.341121 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-04917fdd-f5d9-4e5f-b7ff-aee5e05180c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.394076 Aug 24 05:45:22.343204 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 70/138] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:21 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:22.354704 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c73e33dd-7dc4-48b1-bc12-f3255240abd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:22.367933 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c73e33dd-7dc4-48b1-bc12-f3255240abd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.389077 Aug 24 05:45:22.369084 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 69/139] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:21 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:22.593523 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6d160000-6a64-4b6e-8848-66abd7ea527a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:22.594153 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6d160000-6a64-4b6e-8848-66abd7ea527a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:22.600868 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6d160000-6a64-4b6e-8848-66abd7ea527a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:22.601358 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6d160000-6a64-4b6e-8848-66abd7ea527a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:22.601792 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6d160000-6a64-4b6e-8848-66abd7ea527a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:22.602489 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6d160000-6a64-4b6e-8848-66abd7ea527a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:22.602938 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6d160000-6a64-4b6e-8848-66abd7ea527a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:22.603361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6d160000-6a64-4b6e-8848-66abd7ea527a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:22.665341 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-c4a8db0f-9eb3-4784-84b9-a87b59684341 req-34cead92-4d0c-41ab-84b5-fe198d871e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876be02b-9b39-4f01-9650-28904167d60f", "name": "network-vif-plugged", "status": "completed", "tag": "43f1d0e1-4b2c-4e2b-95d1-f3ec8ce75535"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:45:22.700225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-c4a8db0f-9eb3-4784-84b9-a87b59684341 req-34cead92-4d0c-41ab-84b5-fe198d871e8c service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:22.700225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-c4a8db0f-9eb3-4784-84b9-a87b59684341 req-34cead92-4d0c-41ab-84b5-fe198d871e8c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:22.700225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-c4a8db0f-9eb3-4784-84b9-a87b59684341 req-34cead92-4d0c-41ab-84b5-fe198d871e8c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:22.705942 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-c4a8db0f-9eb3-4784-84b9-a87b59684341 req-34cead92-4d0c-41ab-84b5-fe198d871e8c service nova] Creating event network-vif-plugged:43f1d0e1-4b2c-4e2b-95d1-f3ec8ce75535 for instance 876be02b-9b39-4f01-9650-28904167d60f on hv-cinder-85426 Aug 24 05:45:22.711918 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-c4a8db0f-9eb3-4784-84b9-a87b59684341 req-34cead92-4d0c-41ab-84b5-fe198d871e8c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050179 Aug 24 05:45:22.712834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 70/140] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:45:22.767957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6d160000-6a64-4b6e-8848-66abd7ea527a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:22.776725 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6d160000-6a64-4b6e-8848-66abd7ea527a tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.192790 Aug 24 05:45:22.777572 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 71/141] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:22 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:23.369560 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-73ee232b-0139-4e39-a1da-d6bd82a47aa0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:23.370278 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-73ee232b-0139-4e39-a1da-d6bd82a47aa0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:23.376939 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-73ee232b-0139-4e39-a1da-d6bd82a47aa0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:23.377441 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-73ee232b-0139-4e39-a1da-d6bd82a47aa0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:23.378322 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-73ee232b-0139-4e39-a1da-d6bd82a47aa0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:23.378576 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-73ee232b-0139-4e39-a1da-d6bd82a47aa0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:23.379033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-73ee232b-0139-4e39-a1da-d6bd82a47aa0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:23.379464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-73ee232b-0139-4e39-a1da-d6bd82a47aa0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:23.390480 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8efc3373-fc68-41eb-abba-c9c70978f7bf tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:23.396967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8efc3373-fc68-41eb-abba-c9c70978f7bf tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:23.411526 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8efc3373-fc68-41eb-abba-c9c70978f7bf tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:23.412512 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8efc3373-fc68-41eb-abba-c9c70978f7bf tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:23.413276 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8efc3373-fc68-41eb-abba-c9c70978f7bf tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:23.415209 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8efc3373-fc68-41eb-abba-c9c70978f7bf tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:23.427896 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8efc3373-fc68-41eb-abba-c9c70978f7bf tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:23.428368 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8efc3373-fc68-41eb-abba-c9c70978f7bf tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:23.873089 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-73ee232b-0139-4e39-a1da-d6bd82a47aa0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:23.881931 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-73ee232b-0139-4e39-a1da-d6bd82a47aa0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.516659 Aug 24 05:45:23.883118 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 71/142] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:23 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:23.894673 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bc801121-9c22-4cbb-96b8-8d982bbaaad5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:23.896083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bc801121-9c22-4cbb-96b8-8d982bbaaad5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:23.904407 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8efc3373-fc68-41eb-abba-c9c70978f7bf tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:23.915914 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc801121-9c22-4cbb-96b8-8d982bbaaad5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:23.915914 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc801121-9c22-4cbb-96b8-8d982bbaaad5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:23.916700 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc801121-9c22-4cbb-96b8-8d982bbaaad5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:23.917471 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc801121-9c22-4cbb-96b8-8d982bbaaad5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:23.917937 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc801121-9c22-4cbb-96b8-8d982bbaaad5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:23.927075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc801121-9c22-4cbb-96b8-8d982bbaaad5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:23.928643 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8efc3373-fc68-41eb-abba-c9c70978f7bf tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.541672 Aug 24 05:45:23.971094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 72/143] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:23 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:24.209509 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bc801121-9c22-4cbb-96b8-8d982bbaaad5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:24.224066 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bc801121-9c22-4cbb-96b8-8d982bbaaad5 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.338789 Aug 24 05:45:24.224705 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 72/144] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:23 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:24.905154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-759165db-76aa-4ad9-9350-80854979e2ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:24.906061 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-759165db-76aa-4ad9-9350-80854979e2ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:24.913826 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-759165db-76aa-4ad9-9350-80854979e2ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:24.914288 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-759165db-76aa-4ad9-9350-80854979e2ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:24.914759 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-759165db-76aa-4ad9-9350-80854979e2ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:24.915450 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-759165db-76aa-4ad9-9350-80854979e2ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:24.916173 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-759165db-76aa-4ad9-9350-80854979e2ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:24.916637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-759165db-76aa-4ad9-9350-80854979e2ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:24.971833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d1ed448e-8892-4e40-8a26-964e3475902f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:24.973446 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d1ed448e-8892-4e40-8a26-964e3475902f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:24.979458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1ed448e-8892-4e40-8a26-964e3475902f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:24.979950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1ed448e-8892-4e40-8a26-964e3475902f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:24.980391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1ed448e-8892-4e40-8a26-964e3475902f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:24.982024 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1ed448e-8892-4e40-8a26-964e3475902f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:24.994164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1ed448e-8892-4e40-8a26-964e3475902f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:24.994164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1ed448e-8892-4e40-8a26-964e3475902f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:25.151846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-759165db-76aa-4ad9-9350-80854979e2ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:25.161035 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-759165db-76aa-4ad9-9350-80854979e2ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.259735 Aug 24 05:45:25.162387 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 73/145] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:24 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:25.202334 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d1ed448e-8892-4e40-8a26-964e3475902f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:25.212883 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d1ed448e-8892-4e40-8a26-964e3475902f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.245473 Aug 24 05:45:25.213703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 73/146] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:24 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:25.260465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-794ee61c-8f81-43c1-9d65-32262f52709e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:25.260465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-794ee61c-8f81-43c1-9d65-32262f52709e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:25.265108 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-794ee61c-8f81-43c1-9d65-32262f52709e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:25.265598 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-794ee61c-8f81-43c1-9d65-32262f52709e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:25.266031 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-794ee61c-8f81-43c1-9d65-32262f52709e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:25.266755 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-794ee61c-8f81-43c1-9d65-32262f52709e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:25.267241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-794ee61c-8f81-43c1-9d65-32262f52709e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:25.268714 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-794ee61c-8f81-43c1-9d65-32262f52709e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:25.438795 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-794ee61c-8f81-43c1-9d65-32262f52709e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:25.449640 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-794ee61c-8f81-43c1-9d65-32262f52709e tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.197343 Aug 24 05:45:25.450346 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 74/147] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:25 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:26.197336 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8adbf783-85de-4399-9c11-9a9155865902 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:26.198049 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8adbf783-85de-4399-9c11-9a9155865902 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:26.206780 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8adbf783-85de-4399-9c11-9a9155865902 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:26.209898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8adbf783-85de-4399-9c11-9a9155865902 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:26.209898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8adbf783-85de-4399-9c11-9a9155865902 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:26.209898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8adbf783-85de-4399-9c11-9a9155865902 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:26.209898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8adbf783-85de-4399-9c11-9a9155865902 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:26.210649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8adbf783-85de-4399-9c11-9a9155865902 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:26.240119 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2fafd02a-650e-4b76-b5a8-196936b2cc06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:26.241190 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2fafd02a-650e-4b76-b5a8-196936b2cc06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:26.252015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2fafd02a-650e-4b76-b5a8-196936b2cc06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:26.254928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2fafd02a-650e-4b76-b5a8-196936b2cc06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:26.257507 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2fafd02a-650e-4b76-b5a8-196936b2cc06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:26.258290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2fafd02a-650e-4b76-b5a8-196936b2cc06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:26.260437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2fafd02a-650e-4b76-b5a8-196936b2cc06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:26.261093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2fafd02a-650e-4b76-b5a8-196936b2cc06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:26.563366 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8adbf783-85de-4399-9c11-9a9155865902 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:26.573350 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8adbf783-85de-4399-9c11-9a9155865902 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.381791 Aug 24 05:45:26.574512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 74/148] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:26 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:26.592756 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5dc1e8e1-5182-4013-9e0f-983a7daf6263 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:26.593701 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5dc1e8e1-5182-4013-9e0f-983a7daf6263 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:26.601622 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5dc1e8e1-5182-4013-9e0f-983a7daf6263 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:26.602363 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5dc1e8e1-5182-4013-9e0f-983a7daf6263 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:26.602986 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5dc1e8e1-5182-4013-9e0f-983a7daf6263 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:26.603847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5dc1e8e1-5182-4013-9e0f-983a7daf6263 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:26.604546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5dc1e8e1-5182-4013-9e0f-983a7daf6263 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:26.605130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5dc1e8e1-5182-4013-9e0f-983a7daf6263 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:26.623825 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2fafd02a-650e-4b76-b5a8-196936b2cc06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:26.642865 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2fafd02a-650e-4b76-b5a8-196936b2cc06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.407637 Aug 24 05:45:26.644277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 75/149] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:26 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:26.815732 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5dc1e8e1-5182-4013-9e0f-983a7daf6263 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:26.823808 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5dc1e8e1-5182-4013-9e0f-983a7daf6263 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.247976 Aug 24 05:45:26.824429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 75/150] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:26 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:27.605101 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6eb189f3-be6c-4a26-9694-f3d0b931d5fa tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:27.606190 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6eb189f3-be6c-4a26-9694-f3d0b931d5fa tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:27.631534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb189f3-be6c-4a26-9694-f3d0b931d5fa tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:27.631958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb189f3-be6c-4a26-9694-f3d0b931d5fa tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:27.633513 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb189f3-be6c-4a26-9694-f3d0b931d5fa tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:27.634653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb189f3-be6c-4a26-9694-f3d0b931d5fa tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:27.635371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb189f3-be6c-4a26-9694-f3d0b931d5fa tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:27.636005 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb189f3-be6c-4a26-9694-f3d0b931d5fa tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:27.683020 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bf7daf2a-93e8-43e1-8405-0473d9817c40 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:27.683745 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bf7daf2a-93e8-43e1-8405-0473d9817c40 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:27.711910 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf7daf2a-93e8-43e1-8405-0473d9817c40 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:27.712451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf7daf2a-93e8-43e1-8405-0473d9817c40 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:27.712908 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf7daf2a-93e8-43e1-8405-0473d9817c40 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:27.713645 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf7daf2a-93e8-43e1-8405-0473d9817c40 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:27.714100 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf7daf2a-93e8-43e1-8405-0473d9817c40 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:27.714605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf7daf2a-93e8-43e1-8405-0473d9817c40 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:27.995606 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6eb189f3-be6c-4a26-9694-f3d0b931d5fa tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:28.006181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6eb189f3-be6c-4a26-9694-f3d0b931d5fa tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.407770 Aug 24 05:45:28.007575 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 76/151] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:27 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:28.014328 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9feeea22-f765-428e-ba74-d994851baa84 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:28.015539 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9feeea22-f765-428e-ba74-d994851baa84 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:28.023450 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9feeea22-f765-428e-ba74-d994851baa84 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:28.024283 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9feeea22-f765-428e-ba74-d994851baa84 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:28.024887 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9feeea22-f765-428e-ba74-d994851baa84 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:28.025963 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9feeea22-f765-428e-ba74-d994851baa84 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:28.026534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9feeea22-f765-428e-ba74-d994851baa84 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:28.027125 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9feeea22-f765-428e-ba74-d994851baa84 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:28.557451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bf7daf2a-93e8-43e1-8405-0473d9817c40 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:28.566520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bf7daf2a-93e8-43e1-8405-0473d9817c40 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.891066 Aug 24 05:45:28.567115 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 76/152] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:27 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:28.582016 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9feeea22-f765-428e-ba74-d994851baa84 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:28.590179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9feeea22-f765-428e-ba74-d994851baa84 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.580290 Aug 24 05:45:28.590772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 77/153] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:28 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:29.033220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-74bd44e6-534c-4802-851a-16d62697c254 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:29.036634 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-74bd44e6-534c-4802-851a-16d62697c254 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:29.063622 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74bd44e6-534c-4802-851a-16d62697c254 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:29.067628 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74bd44e6-534c-4802-851a-16d62697c254 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:29.067628 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74bd44e6-534c-4802-851a-16d62697c254 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:29.068464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74bd44e6-534c-4802-851a-16d62697c254 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:29.076802 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74bd44e6-534c-4802-851a-16d62697c254 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:29.077624 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74bd44e6-534c-4802-851a-16d62697c254 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:29.327046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-74bd44e6-534c-4802-851a-16d62697c254 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:29.339348 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-74bd44e6-534c-4802-851a-16d62697c254 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.314750 Aug 24 05:45:29.340023 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 77/154] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:29 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:29.597618 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8f307c36-eb50-477e-ac08-d6ef0d55eae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:29.601716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8f307c36-eb50-477e-ac08-d6ef0d55eae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:29.614282 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f307c36-eb50-477e-ac08-d6ef0d55eae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:29.615688 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f307c36-eb50-477e-ac08-d6ef0d55eae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:29.616944 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f307c36-eb50-477e-ac08-d6ef0d55eae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:29.618976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f307c36-eb50-477e-ac08-d6ef0d55eae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:29.621125 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f307c36-eb50-477e-ac08-d6ef0d55eae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:29.622359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f307c36-eb50-477e-ac08-d6ef0d55eae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:29.632236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8d9b5d1a-754a-4e98-9e83-410cac5dbded tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:29.638317 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8d9b5d1a-754a-4e98-9e83-410cac5dbded tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:29.646532 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d9b5d1a-754a-4e98-9e83-410cac5dbded tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:29.647702 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d9b5d1a-754a-4e98-9e83-410cac5dbded tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:29.648592 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d9b5d1a-754a-4e98-9e83-410cac5dbded tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:29.650538 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d9b5d1a-754a-4e98-9e83-410cac5dbded tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:29.651586 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d9b5d1a-754a-4e98-9e83-410cac5dbded tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:29.652575 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d9b5d1a-754a-4e98-9e83-410cac5dbded tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:30.004180 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8f307c36-eb50-477e-ac08-d6ef0d55eae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:30.024271 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8f307c36-eb50-477e-ac08-d6ef0d55eae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.436485 Aug 24 05:45:30.046334 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 78/155] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:29 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:30.052721 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8d9b5d1a-754a-4e98-9e83-410cac5dbded tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:30.076911 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8d9b5d1a-754a-4e98-9e83-410cac5dbded tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.446431 Aug 24 05:45:30.077262 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 78/156] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:29 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:30.363585 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e148e739-c5eb-4bc0-9cbf-61dd982b23ce tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:30.364521 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e148e739-c5eb-4bc0-9cbf-61dd982b23ce tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:30.372796 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e148e739-c5eb-4bc0-9cbf-61dd982b23ce tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:30.374074 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e148e739-c5eb-4bc0-9cbf-61dd982b23ce tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:30.374969 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e148e739-c5eb-4bc0-9cbf-61dd982b23ce tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:30.375988 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e148e739-c5eb-4bc0-9cbf-61dd982b23ce tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:30.376779 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e148e739-c5eb-4bc0-9cbf-61dd982b23ce tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:30.378194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e148e739-c5eb-4bc0-9cbf-61dd982b23ce tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:30.581331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e148e739-c5eb-4bc0-9cbf-61dd982b23ce tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:30.591177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e148e739-c5eb-4bc0-9cbf-61dd982b23ce tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.231553 Aug 24 05:45:30.593253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 79/157] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:30 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:31.067595 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3cdd3c11-e6d2-4cf6-b6df-a5e4801eab53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:31.069403 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3cdd3c11-e6d2-4cf6-b6df-a5e4801eab53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:31.082698 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3cdd3c11-e6d2-4cf6-b6df-a5e4801eab53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:31.084783 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3cdd3c11-e6d2-4cf6-b6df-a5e4801eab53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:31.086144 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3cdd3c11-e6d2-4cf6-b6df-a5e4801eab53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:31.088076 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3cdd3c11-e6d2-4cf6-b6df-a5e4801eab53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:31.089210 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3cdd3c11-e6d2-4cf6-b6df-a5e4801eab53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:31.090280 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3cdd3c11-e6d2-4cf6-b6df-a5e4801eab53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:31.107095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4be3a038-ab8b-4410-87ee-828f65ee64fa tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:31.108547 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4be3a038-ab8b-4410-87ee-828f65ee64fa tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:31.121943 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4be3a038-ab8b-4410-87ee-828f65ee64fa tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:31.122973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4be3a038-ab8b-4410-87ee-828f65ee64fa tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:31.123838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4be3a038-ab8b-4410-87ee-828f65ee64fa tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:31.125297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4be3a038-ab8b-4410-87ee-828f65ee64fa tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:31.129357 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4be3a038-ab8b-4410-87ee-828f65ee64fa tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:31.129357 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4be3a038-ab8b-4410-87ee-828f65ee64fa tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:31.160852 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:31.196486 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:31.399746 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3cdd3c11-e6d2-4cf6-b6df-a5e4801eab53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:31.414774 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3cdd3c11-e6d2-4cf6-b6df-a5e4801eab53 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.354866 Aug 24 05:45:31.415527 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 79/158] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:31 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:31.416436 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4be3a038-ab8b-4410-87ee-828f65ee64fa tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:31.430831 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4be3a038-ab8b-4410-87ee-828f65ee64fa tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.331285 Aug 24 05:45:31.431808 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 80/159] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:31 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:31.628796 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0a16f7f9-f9e6-452b-806a-c2849495ccfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:31.629560 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0a16f7f9-f9e6-452b-806a-c2849495ccfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:31.638392 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a16f7f9-f9e6-452b-806a-c2849495ccfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:31.638954 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a16f7f9-f9e6-452b-806a-c2849495ccfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:31.639410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a16f7f9-f9e6-452b-806a-c2849495ccfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:31.640107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a16f7f9-f9e6-452b-806a-c2849495ccfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:31.640603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a16f7f9-f9e6-452b-806a-c2849495ccfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:31.641446 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a16f7f9-f9e6-452b-806a-c2849495ccfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:31.813408 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0a16f7f9-f9e6-452b-806a-c2849495ccfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:31.823036 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0a16f7f9-f9e6-452b-806a-c2849495ccfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.202323 Aug 24 05:45:31.823573 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 80/160] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:31 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:32.436236 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3f5392d8-0b5b-4c47-8134-702de00f0673 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:32.437007 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3f5392d8-0b5b-4c47-8134-702de00f0673 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:32.445271 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f5392d8-0b5b-4c47-8134-702de00f0673 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:32.445760 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f5392d8-0b5b-4c47-8134-702de00f0673 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:32.446200 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f5392d8-0b5b-4c47-8134-702de00f0673 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:32.446899 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f5392d8-0b5b-4c47-8134-702de00f0673 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:32.447356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f5392d8-0b5b-4c47-8134-702de00f0673 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:32.447783 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f5392d8-0b5b-4c47-8134-702de00f0673 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:32.457417 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-dbbc4d4e-c379-4e79-9a42-feb7145286a8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:32.458125 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-dbbc4d4e-c379-4e79-9a42-feb7145286a8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:32.465070 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbbc4d4e-c379-4e79-9a42-feb7145286a8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:32.465627 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbbc4d4e-c379-4e79-9a42-feb7145286a8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:32.466126 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbbc4d4e-c379-4e79-9a42-feb7145286a8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:32.466873 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbbc4d4e-c379-4e79-9a42-feb7145286a8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:32.467499 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbbc4d4e-c379-4e79-9a42-feb7145286a8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:32.467943 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbbc4d4e-c379-4e79-9a42-feb7145286a8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:32.660657 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3f5392d8-0b5b-4c47-8134-702de00f0673 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:32.678772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dbbc4d4e-c379-4e79-9a42-feb7145286a8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:32.692890 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3f5392d8-0b5b-4c47-8134-702de00f0673 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.257689 Aug 24 05:45:32.695108 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 81/161] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:32 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:32.697604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-dbbc4d4e-c379-4e79-9a42-feb7145286a8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.244464 Aug 24 05:45:32.698663 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 81/162] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:32 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:32.844901 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-65fde683-d72b-49e5-a7aa-ee1968f540d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:32.845536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-65fde683-d72b-49e5-a7aa-ee1968f540d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:32.856159 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-65fde683-d72b-49e5-a7aa-ee1968f540d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:32.856159 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-65fde683-d72b-49e5-a7aa-ee1968f540d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:32.856159 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-65fde683-d72b-49e5-a7aa-ee1968f540d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:32.856721 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-65fde683-d72b-49e5-a7aa-ee1968f540d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:32.857291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-65fde683-d72b-49e5-a7aa-ee1968f540d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:32.857572 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-65fde683-d72b-49e5-a7aa-ee1968f540d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:33.029714 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-65fde683-d72b-49e5-a7aa-ee1968f540d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:33.046163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-65fde683-d72b-49e5-a7aa-ee1968f540d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.204698 Aug 24 05:45:33.047215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 82/163] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:32 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:33.721394 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ff6866d2-7f58-4ea7-885a-2f18ac37030d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:33.722528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ff6866d2-7f58-4ea7-885a-2f18ac37030d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:33.728718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4d6a25ca-237c-4037-b357-e9365a48adf8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:33.729293 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff6866d2-7f58-4ea7-885a-2f18ac37030d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:33.729394 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff6866d2-7f58-4ea7-885a-2f18ac37030d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:33.729806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff6866d2-7f58-4ea7-885a-2f18ac37030d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:33.729999 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4d6a25ca-237c-4037-b357-e9365a48adf8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:33.730565 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff6866d2-7f58-4ea7-885a-2f18ac37030d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:33.731022 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff6866d2-7f58-4ea7-885a-2f18ac37030d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:33.732151 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff6866d2-7f58-4ea7-885a-2f18ac37030d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:33.737299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d6a25ca-237c-4037-b357-e9365a48adf8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:33.738062 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d6a25ca-237c-4037-b357-e9365a48adf8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:33.738621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d6a25ca-237c-4037-b357-e9365a48adf8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:33.739438 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d6a25ca-237c-4037-b357-e9365a48adf8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:33.740049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d6a25ca-237c-4037-b357-e9365a48adf8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:33.740606 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d6a25ca-237c-4037-b357-e9365a48adf8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:33.954978 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4d6a25ca-237c-4037-b357-e9365a48adf8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:33.959122 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ff6866d2-7f58-4ea7-885a-2f18ac37030d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:33.964943 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4d6a25ca-237c-4037-b357-e9365a48adf8 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.241550 Aug 24 05:45:33.965524 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 83/164] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:33 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:33.968711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ff6866d2-7f58-4ea7-885a-2f18ac37030d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.251364 Aug 24 05:45:33.969786 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 82/165] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:33 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:34.067727 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a27ac4cd-9204-4d0b-9376-370a6464abca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:34.068365 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a27ac4cd-9204-4d0b-9376-370a6464abca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:34.074264 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a27ac4cd-9204-4d0b-9376-370a6464abca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:34.074738 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a27ac4cd-9204-4d0b-9376-370a6464abca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:34.075166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a27ac4cd-9204-4d0b-9376-370a6464abca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:34.075839 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a27ac4cd-9204-4d0b-9376-370a6464abca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:34.076283 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a27ac4cd-9204-4d0b-9376-370a6464abca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:34.076723 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a27ac4cd-9204-4d0b-9376-370a6464abca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:34.236784 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a27ac4cd-9204-4d0b-9376-370a6464abca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:34.240035 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a27ac4cd-9204-4d0b-9376-370a6464abca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.176850 Aug 24 05:45:34.240728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 84/166] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:34 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:34.992105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-568eccc1-cce6-46c6-92e4-d39a1f7dfe54 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:34.993072 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-568eccc1-cce6-46c6-92e4-d39a1f7dfe54 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:34.995249 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=76 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:34.995807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d8c4a374-1d15-4a55-a0df-f6ded10305a6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:34.996848 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d8c4a374-1d15-4a55-a0df-f6ded10305a6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:35.007401 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-568eccc1-cce6-46c6-92e4-d39a1f7dfe54 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:35.007892 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-568eccc1-cce6-46c6-92e4-d39a1f7dfe54 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:35.008339 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-568eccc1-cce6-46c6-92e4-d39a1f7dfe54 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:35.009080 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-568eccc1-cce6-46c6-92e4-d39a1f7dfe54 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:35.009535 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-568eccc1-cce6-46c6-92e4-d39a1f7dfe54 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:35.010065 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-568eccc1-cce6-46c6-92e4-d39a1f7dfe54 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:35.018281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d8c4a374-1d15-4a55-a0df-f6ded10305a6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:35.019186 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d8c4a374-1d15-4a55-a0df-f6ded10305a6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:35.019765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d8c4a374-1d15-4a55-a0df-f6ded10305a6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:35.023752 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d8c4a374-1d15-4a55-a0df-f6ded10305a6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:35.029781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d8c4a374-1d15-4a55-a0df-f6ded10305a6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:35.030239 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d8c4a374-1d15-4a55-a0df-f6ded10305a6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:35.308731 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d8c4a374-1d15-4a55-a0df-f6ded10305a6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:35.312235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-568eccc1-cce6-46c6-92e4-d39a1f7dfe54 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:35.317678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d8c4a374-1d15-4a55-a0df-f6ded10305a6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.329144 Aug 24 05:45:35.318520 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 85/167] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:34 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:35.322373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-568eccc1-cce6-46c6-92e4-d39a1f7dfe54 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.334313 Aug 24 05:45:35.322911 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 83/168] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:34 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:35.333091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d1e2e2cd-4f80-4772-b211-98cd341d79fe tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:35.333760 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d1e2e2cd-4f80-4772-b211-98cd341d79fe tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:35.339513 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d1e2e2cd-4f80-4772-b211-98cd341d79fe tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:35.339987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d1e2e2cd-4f80-4772-b211-98cd341d79fe tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:35.340432 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d1e2e2cd-4f80-4772-b211-98cd341d79fe tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:35.341117 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d1e2e2cd-4f80-4772-b211-98cd341d79fe tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:35.341565 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d1e2e2cd-4f80-4772-b211-98cd341d79fe tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:35.341977 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d1e2e2cd-4f80-4772-b211-98cd341d79fe tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:35.479178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d1e2e2cd-4f80-4772-b211-98cd341d79fe tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:35.491644 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d1e2e2cd-4f80-4772-b211-98cd341d79fe tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.171713 Aug 24 05:45:35.492426 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 86/169] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:35 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:35.992586 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-605c7d5c-efb2-42a2-b75a-6331de6ecd27 req-66f83e78-e509-4221-b071-0bbd5631dfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ebc8e1-e92d-4891-9d63-7a24cb4f9536", "name": "network-vif-plugged", "status": "completed", "tag": "13810f52-c423-464f-b3c5-0aa15c6ac45a"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:45:36.009605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-605c7d5c-efb2-42a2-b75a-6331de6ecd27 req-66f83e78-e509-4221-b071-0bbd5631dfc8 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:36.010080 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-605c7d5c-efb2-42a2-b75a-6331de6ecd27 req-66f83e78-e509-4221-b071-0bbd5631dfc8 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:36.010511 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-605c7d5c-efb2-42a2-b75a-6331de6ecd27 req-66f83e78-e509-4221-b071-0bbd5631dfc8 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:36.022938 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-605c7d5c-efb2-42a2-b75a-6331de6ecd27 req-66f83e78-e509-4221-b071-0bbd5631dfc8 service nova] Creating event network-vif-plugged:13810f52-c423-464f-b3c5-0aa15c6ac45a for instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 on hv-cinder-85426 Aug 24 05:45:36.028515 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-605c7d5c-efb2-42a2-b75a-6331de6ecd27 req-66f83e78-e509-4221-b071-0bbd5631dfc8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040451 Aug 24 05:45:36.029134 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 84/170] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:36.338454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f3a883ad-195a-4e88-9584-f94202e9a9de tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:36.339772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f3a883ad-195a-4e88-9584-f94202e9a9de tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:36.346534 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-910574f4-0965-4ec4-ad75-7cc5f76fab21 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:36.347633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3a883ad-195a-4e88-9584-f94202e9a9de tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:36.348376 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3a883ad-195a-4e88-9584-f94202e9a9de tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:36.348720 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-910574f4-0965-4ec4-ad75-7cc5f76fab21 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:36.349343 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3a883ad-195a-4e88-9584-f94202e9a9de tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:36.350339 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3a883ad-195a-4e88-9584-f94202e9a9de tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:36.351023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3a883ad-195a-4e88-9584-f94202e9a9de tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:36.351663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3a883ad-195a-4e88-9584-f94202e9a9de tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:36.360009 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-910574f4-0965-4ec4-ad75-7cc5f76fab21 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:36.360569 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-910574f4-0965-4ec4-ad75-7cc5f76fab21 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:36.361015 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-910574f4-0965-4ec4-ad75-7cc5f76fab21 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:36.362545 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-910574f4-0965-4ec4-ad75-7cc5f76fab21 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:36.363136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-910574f4-0965-4ec4-ad75-7cc5f76fab21 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:36.363566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-910574f4-0965-4ec4-ad75-7cc5f76fab21 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:36.626132 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f3a883ad-195a-4e88-9584-f94202e9a9de tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:36.629803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-910574f4-0965-4ec4-ad75-7cc5f76fab21 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:36.630261 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f3a883ad-195a-4e88-9584-f94202e9a9de tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.270602 Aug 24 05:45:36.630261 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 87/171] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:36 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:36.630588 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-910574f4-0965-4ec4-ad75-7cc5f76fab21 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.269121 Aug 24 05:45:36.630588 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 85/172] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:36 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:36.631050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-965858e7-d408-451a-bf17-1032e31c5ed0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:36.631050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-965858e7-d408-451a-bf17-1032e31c5ed0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:36.631050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-965858e7-d408-451a-bf17-1032e31c5ed0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:36.631050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-965858e7-d408-451a-bf17-1032e31c5ed0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:36.631859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-965858e7-d408-451a-bf17-1032e31c5ed0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:36.631859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-965858e7-d408-451a-bf17-1032e31c5ed0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:36.631859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-965858e7-d408-451a-bf17-1032e31c5ed0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:36.631859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-965858e7-d408-451a-bf17-1032e31c5ed0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:36.806293 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-965858e7-d408-451a-bf17-1032e31c5ed0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:36.814278 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-965858e7-d408-451a-bf17-1032e31c5ed0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1366 microversion: 2.1 time: 0.207384 Aug 24 05:45:36.815522 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 88/173] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:36 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:37.647049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-88189281-8779-4519-aa55-1e87e3fb7de2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:37.648277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-88189281-8779-4519-aa55-1e87e3fb7de2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:37.650125 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b35b1fc2-5bcd-4aa7-a4c1-e0c90c0e10a0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:37.651269 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b35b1fc2-5bcd-4aa7-a4c1-e0c90c0e10a0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:37.654247 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=76 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:37.655925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88189281-8779-4519-aa55-1e87e3fb7de2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:37.656768 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88189281-8779-4519-aa55-1e87e3fb7de2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:37.657707 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88189281-8779-4519-aa55-1e87e3fb7de2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:37.658562 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88189281-8779-4519-aa55-1e87e3fb7de2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:37.659226 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88189281-8779-4519-aa55-1e87e3fb7de2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:37.659853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88189281-8779-4519-aa55-1e87e3fb7de2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:37.660946 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b35b1fc2-5bcd-4aa7-a4c1-e0c90c0e10a0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:37.661561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b35b1fc2-5bcd-4aa7-a4c1-e0c90c0e10a0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:37.662175 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b35b1fc2-5bcd-4aa7-a4c1-e0c90c0e10a0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:37.663340 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b35b1fc2-5bcd-4aa7-a4c1-e0c90c0e10a0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:37.664149 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b35b1fc2-5bcd-4aa7-a4c1-e0c90c0e10a0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:37.664789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b35b1fc2-5bcd-4aa7-a4c1-e0c90c0e10a0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:37.932890 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-88189281-8779-4519-aa55-1e87e3fb7de2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:37.951646 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-88189281-8779-4519-aa55-1e87e3fb7de2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.308869 Aug 24 05:45:37.969141 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 89/174] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:37 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:37.973471 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d4931e85-b985-4035-8b78-a3f240f11595 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:37.981285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d4931e85-b985-4035-8b78-a3f240f11595 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:38.001692 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4931e85-b985-4035-8b78-a3f240f11595 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:38.003993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4931e85-b985-4035-8b78-a3f240f11595 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:38.009720 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4931e85-b985-4035-8b78-a3f240f11595 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:38.010188 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4931e85-b985-4035-8b78-a3f240f11595 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:38.011209 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4931e85-b985-4035-8b78-a3f240f11595 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:38.011976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4931e85-b985-4035-8b78-a3f240f11595 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:38.064740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b35b1fc2-5bcd-4aa7-a4c1-e0c90c0e10a0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:38.087283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b35b1fc2-5bcd-4aa7-a4c1-e0c90c0e10a0 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.435789 Aug 24 05:45:38.087283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 86/175] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:37 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:38.095122 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-fed06788-1912-452f-a04c-f0048c627bba req-809f0cfe-62e0-4f17-ab98-75cd4e255792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e", "name": "network-vif-plugged", "status": "completed", "tag": "ac54fa94-5136-4f4f-9757-f1ec362eb68d"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:45:38.114414 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-fed06788-1912-452f-a04c-f0048c627bba req-809f0cfe-62e0-4f17-ab98-75cd4e255792 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:38.117955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-fed06788-1912-452f-a04c-f0048c627bba req-809f0cfe-62e0-4f17-ab98-75cd4e255792 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:38.117955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-fed06788-1912-452f-a04c-f0048c627bba req-809f0cfe-62e0-4f17-ab98-75cd4e255792 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:38.138406 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-fed06788-1912-452f-a04c-f0048c627bba req-809f0cfe-62e0-4f17-ab98-75cd4e255792 service nova] Creating event network-vif-plugged:ac54fa94-5136-4f4f-9757-f1ec362eb68d for instance c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e on hv-cinder-85426 Aug 24 05:45:38.148223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-fed06788-1912-452f-a04c-f0048c627bba req-809f0cfe-62e0-4f17-ab98-75cd4e255792 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062457 Aug 24 05:45:38.149889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 87/176] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:38.266656 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d4931e85-b985-4035-8b78-a3f240f11595 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:38.275527 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d4931e85-b985-4035-8b78-a3f240f11595 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1556 microversion: 2.1 time: 0.315643 Aug 24 05:45:38.276131 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 90/177] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:37 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1556 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:38.301090 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8899e393-4297-4ab1-825d-3f1b6b414fd1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:38.301667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8899e393-4297-4ab1-825d-3f1b6b414fd1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:38.308362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8899e393-4297-4ab1-825d-3f1b6b414fd1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:38.308912 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8899e393-4297-4ab1-825d-3f1b6b414fd1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:38.309350 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8899e393-4297-4ab1-825d-3f1b6b414fd1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:38.310055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8899e393-4297-4ab1-825d-3f1b6b414fd1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:38.310501 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8899e393-4297-4ab1-825d-3f1b6b414fd1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:38.310967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8899e393-4297-4ab1-825d-3f1b6b414fd1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:38.453149 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8899e393-4297-4ab1-825d-3f1b6b414fd1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156518 Aug 24 05:45:38.454287 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 88/178] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 24 05:45:38 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:38.982780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d0f8e1d7-c3b4-445b-a922-1a659781c50f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:38.988175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d0f8e1d7-c3b4-445b-a922-1a659781c50f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:39.031560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0f8e1d7-c3b4-445b-a922-1a659781c50f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:39.031560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0f8e1d7-c3b4-445b-a922-1a659781c50f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:39.031560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0f8e1d7-c3b4-445b-a922-1a659781c50f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:39.031560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0f8e1d7-c3b4-445b-a922-1a659781c50f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:39.031854 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0f8e1d7-c3b4-445b-a922-1a659781c50f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:39.031854 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d0f8e1d7-c3b4-445b-a922-1a659781c50f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:39.106933 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ef3d7fcd-2677-44c9-afb6-d6aaa1649882 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:39.107523 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ef3d7fcd-2677-44c9-afb6-d6aaa1649882 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:39.114482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef3d7fcd-2677-44c9-afb6-d6aaa1649882 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:39.114965 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef3d7fcd-2677-44c9-afb6-d6aaa1649882 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:39.115393 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef3d7fcd-2677-44c9-afb6-d6aaa1649882 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:39.116086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef3d7fcd-2677-44c9-afb6-d6aaa1649882 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:39.116588 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef3d7fcd-2677-44c9-afb6-d6aaa1649882 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:39.117030 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef3d7fcd-2677-44c9-afb6-d6aaa1649882 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:39.292789 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d0f8e1d7-c3b4-445b-a922-1a659781c50f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:39.303673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d0f8e1d7-c3b4-445b-a922-1a659781c50f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.324792 Aug 24 05:45:39.305023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 91/179] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:38 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:39.329920 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ef3d7fcd-2677-44c9-afb6-d6aaa1649882 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:39.356574 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ef3d7fcd-2677-44c9-afb6-d6aaa1649882 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.253216 Aug 24 05:45:39.369401 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 89/180] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:39 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:40.342628 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-45a6266b-e855-420f-85a9-e7608b6b373a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:40.343279 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-45a6266b-e855-420f-85a9-e7608b6b373a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:40.352639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45a6266b-e855-420f-85a9-e7608b6b373a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:40.352639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45a6266b-e855-420f-85a9-e7608b6b373a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:40.353166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45a6266b-e855-420f-85a9-e7608b6b373a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:40.354330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45a6266b-e855-420f-85a9-e7608b6b373a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:40.355049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45a6266b-e855-420f-85a9-e7608b6b373a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:40.355486 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45a6266b-e855-420f-85a9-e7608b6b373a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:40.381061 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-cb0de4c7-f882-4f10-8b3f-e94058cb6326 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:40.381590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-cb0de4c7-f882-4f10-8b3f-e94058cb6326 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:40.390770 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb0de4c7-f882-4f10-8b3f-e94058cb6326 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:40.391580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb0de4c7-f882-4f10-8b3f-e94058cb6326 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:40.394407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb0de4c7-f882-4f10-8b3f-e94058cb6326 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:40.397170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb0de4c7-f882-4f10-8b3f-e94058cb6326 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:40.399532 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb0de4c7-f882-4f10-8b3f-e94058cb6326 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:40.400301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb0de4c7-f882-4f10-8b3f-e94058cb6326 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:40.682653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-45a6266b-e855-420f-85a9-e7608b6b373a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:40.697656 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-45a6266b-e855-420f-85a9-e7608b6b373a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.359354 Aug 24 05:45:40.701890 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 92/181] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:40 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:40.713061 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-af1d4fc3-89a2-441e-86a7-262ee97731b6 req-caf3eac1-cd6e-4c8d-81a9-d1f13c8f266b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f94c1e2-6b5c-4d47-bb02-b4c49642dd15", "tag": "3fa886a1-f7b6-41b0-a537-6f9e71b1139c"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:45:40.735004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cb0de4c7-f882-4f10-8b3f-e94058cb6326 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:40.744668 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-cb0de4c7-f882-4f10-8b3f-e94058cb6326 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1315 microversion: 2.1 time: 0.369094 Aug 24 05:45:40.746157 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-af1d4fc3-89a2-441e-86a7-262ee97731b6 req-caf3eac1-cd6e-4c8d-81a9-d1f13c8f266b service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:40.747151 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-af1d4fc3-89a2-441e-86a7-262ee97731b6 req-caf3eac1-cd6e-4c8d-81a9-d1f13c8f266b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:40.748032 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-af1d4fc3-89a2-441e-86a7-262ee97731b6 req-caf3eac1-cd6e-4c8d-81a9-d1f13c8f266b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:40.763840 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 90/182] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:40 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:40.786243 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-af1d4fc3-89a2-441e-86a7-262ee97731b6 req-caf3eac1-cd6e-4c8d-81a9-d1f13c8f266b service nova] Creating event network-changed:3fa886a1-f7b6-41b0-a537-6f9e71b1139c for instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 on hv-cinder-85426 Aug 24 05:45:40.799742 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-af1d4fc3-89a2-441e-86a7-262ee97731b6 req-caf3eac1-cd6e-4c8d-81a9-d1f13c8f266b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095565 Aug 24 05:45:40.801332 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 93/183] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:41.727754 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ed4f7015-71f4-4f50-8c1e-4b704f344a62 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:41.728603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ed4f7015-71f4-4f50-8c1e-4b704f344a62 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:41.737239 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed4f7015-71f4-4f50-8c1e-4b704f344a62 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:41.738012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed4f7015-71f4-4f50-8c1e-4b704f344a62 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:41.738470 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed4f7015-71f4-4f50-8c1e-4b704f344a62 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:41.739292 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed4f7015-71f4-4f50-8c1e-4b704f344a62 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:41.739699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed4f7015-71f4-4f50-8c1e-4b704f344a62 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:41.740133 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed4f7015-71f4-4f50-8c1e-4b704f344a62 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:41.783704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3a7f79f3-5957-4335-843a-18b7e676ce90 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:41.786694 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3a7f79f3-5957-4335-843a-18b7e676ce90 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:41.801040 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a7f79f3-5957-4335-843a-18b7e676ce90 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:41.804813 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a7f79f3-5957-4335-843a-18b7e676ce90 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:41.804813 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a7f79f3-5957-4335-843a-18b7e676ce90 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:41.805607 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a7f79f3-5957-4335-843a-18b7e676ce90 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:41.808212 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a7f79f3-5957-4335-843a-18b7e676ce90 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:41.809290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a7f79f3-5957-4335-843a-18b7e676ce90 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:41.993777 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ed4f7015-71f4-4f50-8c1e-4b704f344a62 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:42.005795 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ed4f7015-71f4-4f50-8c1e-4b704f344a62 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.284924 Aug 24 05:45:42.006492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 91/184] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:41 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:42.043046 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3a7f79f3-5957-4335-843a-18b7e676ce90 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:42.058156 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3a7f79f3-5957-4335-843a-18b7e676ce90 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1502 microversion: 2.1 time: 0.287431 Aug 24 05:45:42.066386 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 94/185] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:41 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1502 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:43.038806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0baf2387-e5b4-4990-9ce3-d2c9c352fab5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:43.039889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0baf2387-e5b4-4990-9ce3-d2c9c352fab5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:43.056955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0baf2387-e5b4-4990-9ce3-d2c9c352fab5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:43.056955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0baf2387-e5b4-4990-9ce3-d2c9c352fab5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:43.056955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0baf2387-e5b4-4990-9ce3-d2c9c352fab5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:43.056955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0baf2387-e5b4-4990-9ce3-d2c9c352fab5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:43.057500 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0baf2387-e5b4-4990-9ce3-d2c9c352fab5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:43.057835 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0baf2387-e5b4-4990-9ce3-d2c9c352fab5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:43.306895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0baf2387-e5b4-4990-9ce3-d2c9c352fab5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:43.321376 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0baf2387-e5b4-4990-9ce3-d2c9c352fab5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1322 microversion: 2.1 time: 0.291156 Aug 24 05:45:43.322035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 92/186] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:43 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:44.342997 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-fe5ba148-b709-462c-9df7-a37261c524d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:44.343614 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-fe5ba148-b709-462c-9df7-a37261c524d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:44.350869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fe5ba148-b709-462c-9df7-a37261c524d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:44.351409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fe5ba148-b709-462c-9df7-a37261c524d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:44.351837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fe5ba148-b709-462c-9df7-a37261c524d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:44.352707 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fe5ba148-b709-462c-9df7-a37261c524d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:44.353170 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fe5ba148-b709-462c-9df7-a37261c524d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:44.353614 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fe5ba148-b709-462c-9df7-a37261c524d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:44.503845 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fe5ba148-b709-462c-9df7-a37261c524d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:44.513102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-fe5ba148-b709-462c-9df7-a37261c524d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1516 microversion: 2.1 time: 0.173492 Aug 24 05:45:44.513102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 95/187] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:44 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:44.537025 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-04877a61-74e1-4a65-8a23-70a72c733031 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:45:44.539274 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-04877a61-74e1-4a65-8a23-70a72c733031 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:44.545526 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04877a61-74e1-4a65-8a23-70a72c733031 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:44.546011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04877a61-74e1-4a65-8a23-70a72c733031 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:44.546439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04877a61-74e1-4a65-8a23-70a72c733031 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:44.547129 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04877a61-74e1-4a65-8a23-70a72c733031 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:44.547576 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04877a61-74e1-4a65-8a23-70a72c733031 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:44.548002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04877a61-74e1-4a65-8a23-70a72c733031 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:44.571440 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-04877a61-74e1-4a65-8a23-70a72c733031 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lazy-loading 'flavor' on Instance uuid c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:45:44.987522 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-04877a61-74e1-4a65-8a23-70a72c733031 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "POST /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e/action" status: 200 len: 32 microversion: 2.1 time: 0.454898 Aug 24 05:45:44.988145 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 93/188] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:45:44 2022] POST /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e/action => generated 32 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:45:44.998174 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3d1544fc-634e-4670-af85-b1580776bdfe tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:44.999011 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3d1544fc-634e-4670-af85-b1580776bdfe tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:45.006797 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d1544fc-634e-4670-af85-b1580776bdfe tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:45.007917 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d1544fc-634e-4670-af85-b1580776bdfe tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:45.008620 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d1544fc-634e-4670-af85-b1580776bdfe tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:45.009470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d1544fc-634e-4670-af85-b1580776bdfe tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:45.011033 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d1544fc-634e-4670-af85-b1580776bdfe tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:45.011487 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d1544fc-634e-4670-af85-b1580776bdfe tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:45.044160 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b8749d4d-8d1f-4eb3-b89f-10a3e7c82fff tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0f220ab-1b1f-483a-bb5c-bb9e07d4916e"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:45:45.054583 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b8749d4d-8d1f-4eb3-b89f-10a3e7c82fff tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:45.061192 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8749d4d-8d1f-4eb3-b89f-10a3e7c82fff tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:45.070830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8749d4d-8d1f-4eb3-b89f-10a3e7c82fff tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:45.070830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8749d4d-8d1f-4eb3-b89f-10a3e7c82fff tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:45.070830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8749d4d-8d1f-4eb3-b89f-10a3e7c82fff tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:45.070830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8749d4d-8d1f-4eb3-b89f-10a3e7c82fff tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:45.071278 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8749d4d-8d1f-4eb3-b89f-10a3e7c82fff tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:45.307915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3d1544fc-634e-4670-af85-b1580776bdfe tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:45.324608 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3d1544fc-634e-4670-af85-b1580776bdfe tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.330186 Aug 24 05:45:45.325158 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 96/189] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:44 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:46.351997 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8ea9be21-ed8a-4d8a-a64f-f96ca5d8c904 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:46.352730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8ea9be21-ed8a-4d8a-a64f-f96ca5d8c904 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:46.360053 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ea9be21-ed8a-4d8a-a64f-f96ca5d8c904 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:46.360918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ea9be21-ed8a-4d8a-a64f-f96ca5d8c904 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:46.361495 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ea9be21-ed8a-4d8a-a64f-f96ca5d8c904 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:46.363714 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ea9be21-ed8a-4d8a-a64f-f96ca5d8c904 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:46.364373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ea9be21-ed8a-4d8a-a64f-f96ca5d8c904 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:46.365014 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ea9be21-ed8a-4d8a-a64f-f96ca5d8c904 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:46.618077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8ea9be21-ed8a-4d8a-a64f-f96ca5d8c904 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:46.624611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:46.631721 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8ea9be21-ed8a-4d8a-a64f-f96ca5d8c904 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.287019 Aug 24 05:45:46.632390 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 97/190] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:46 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:45:46.921949 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:47.102440 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b8749d4d-8d1f-4eb3-b89f-10a3e7c82fff tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "POST /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.065023 Aug 24 05:45:47.103172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 94/191] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 05:45:45 2022] POST /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536/os-volume_attachments => generated 194 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:47.658625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-95343b7e-f527-4b4e-9ec9-3ac61748a9b4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:47.662224 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-95343b7e-f527-4b4e-9ec9-3ac61748a9b4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:47.683669 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95343b7e-f527-4b4e-9ec9-3ac61748a9b4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:47.685424 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95343b7e-f527-4b4e-9ec9-3ac61748a9b4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:47.688282 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95343b7e-f527-4b4e-9ec9-3ac61748a9b4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:47.691732 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95343b7e-f527-4b4e-9ec9-3ac61748a9b4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:47.698146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95343b7e-f527-4b4e-9ec9-3ac61748a9b4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:47.698146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95343b7e-f527-4b4e-9ec9-3ac61748a9b4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:48.041269 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-95343b7e-f527-4b4e-9ec9-3ac61748a9b4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:48.058129 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-95343b7e-f527-4b4e-9ec9-3ac61748a9b4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.406718 Aug 24 05:45:48.058978 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 98/192] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:47 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:49.085710 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-da2db74d-a7a9-49b3-a4cb-859ac9171627 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:49.088194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-da2db74d-a7a9-49b3-a4cb-859ac9171627 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:49.106136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-da2db74d-a7a9-49b3-a4cb-859ac9171627 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:49.108681 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-da2db74d-a7a9-49b3-a4cb-859ac9171627 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:49.108681 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-da2db74d-a7a9-49b3-a4cb-859ac9171627 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:49.109180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-da2db74d-a7a9-49b3-a4cb-859ac9171627 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:49.110178 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-da2db74d-a7a9-49b3-a4cb-859ac9171627 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:49.111366 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-da2db74d-a7a9-49b3-a4cb-859ac9171627 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:49.347124 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-da2db74d-a7a9-49b3-a4cb-859ac9171627 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:49.372754 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-da2db74d-a7a9-49b3-a4cb-859ac9171627 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.294335 Aug 24 05:45:49.375364 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 95/193] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:49 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:50.406581 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-69f54175-11ce-4d63-a27a-1a4be062b98e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:50.407652 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-69f54175-11ce-4d63-a27a-1a4be062b98e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:50.441105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69f54175-11ce-4d63-a27a-1a4be062b98e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:50.442149 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69f54175-11ce-4d63-a27a-1a4be062b98e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:50.442959 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69f54175-11ce-4d63-a27a-1a4be062b98e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:50.444260 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69f54175-11ce-4d63-a27a-1a4be062b98e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:50.445365 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69f54175-11ce-4d63-a27a-1a4be062b98e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:50.449142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69f54175-11ce-4d63-a27a-1a4be062b98e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:50.663645 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-69f54175-11ce-4d63-a27a-1a4be062b98e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:50.674173 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-69f54175-11ce-4d63-a27a-1a4be062b98e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.276776 Aug 24 05:45:50.675482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 99/194] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:50 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:51.727129 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5a5882ff-401f-42ee-a6e9-a38958e595e4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:51.727767 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5a5882ff-401f-42ee-a6e9-a38958e595e4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:51.736419 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a5882ff-401f-42ee-a6e9-a38958e595e4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:51.740020 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a5882ff-401f-42ee-a6e9-a38958e595e4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:51.740020 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a5882ff-401f-42ee-a6e9-a38958e595e4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:51.740020 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a5882ff-401f-42ee-a6e9-a38958e595e4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:51.740020 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a5882ff-401f-42ee-a6e9-a38958e595e4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:51.740479 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a5882ff-401f-42ee-a6e9-a38958e595e4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:51.981136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5a5882ff-401f-42ee-a6e9-a38958e595e4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:51.994794 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5a5882ff-401f-42ee-a6e9-a38958e595e4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.274840 Aug 24 05:45:51.995781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 96/195] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:51 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:53.031390 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-83bc661f-5707-411a-8542-b0cf3a5eae15 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:53.032686 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-83bc661f-5707-411a-8542-b0cf3a5eae15 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:53.039188 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83bc661f-5707-411a-8542-b0cf3a5eae15 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:53.039667 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83bc661f-5707-411a-8542-b0cf3a5eae15 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:53.040095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83bc661f-5707-411a-8542-b0cf3a5eae15 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:53.040812 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83bc661f-5707-411a-8542-b0cf3a5eae15 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:53.041520 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83bc661f-5707-411a-8542-b0cf3a5eae15 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:53.041934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83bc661f-5707-411a-8542-b0cf3a5eae15 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:53.264613 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-83bc661f-5707-411a-8542-b0cf3a5eae15 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:53.275085 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-83bc661f-5707-411a-8542-b0cf3a5eae15 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.251150 Aug 24 05:45:53.276006 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 100/196] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:53 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:54.307215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-58d60e02-ee9c-48fe-ac66-7ac437c2d433 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:54.307833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-58d60e02-ee9c-48fe-ac66-7ac437c2d433 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:54.314970 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58d60e02-ee9c-48fe-ac66-7ac437c2d433 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:54.316014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58d60e02-ee9c-48fe-ac66-7ac437c2d433 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:54.319716 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58d60e02-ee9c-48fe-ac66-7ac437c2d433 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:54.319716 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58d60e02-ee9c-48fe-ac66-7ac437c2d433 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:54.319716 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58d60e02-ee9c-48fe-ac66-7ac437c2d433 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:54.319716 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58d60e02-ee9c-48fe-ac66-7ac437c2d433 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:54.517824 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-58d60e02-ee9c-48fe-ac66-7ac437c2d433 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:54.527416 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-58d60e02-ee9c-48fe-ac66-7ac437c2d433 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.224263 Aug 24 05:45:54.528021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 97/197] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:54 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:55.550232 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d578d678-f61c-40f8-8f53-2359e4a1c34d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:55.551761 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d578d678-f61c-40f8-8f53-2359e4a1c34d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:55.558317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d578d678-f61c-40f8-8f53-2359e4a1c34d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:55.558807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d578d678-f61c-40f8-8f53-2359e4a1c34d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:55.559247 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d578d678-f61c-40f8-8f53-2359e4a1c34d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:55.559962 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d578d678-f61c-40f8-8f53-2359e4a1c34d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:55.560477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d578d678-f61c-40f8-8f53-2359e4a1c34d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:55.560919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d578d678-f61c-40f8-8f53-2359e4a1c34d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:55.795462 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d578d678-f61c-40f8-8f53-2359e4a1c34d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:55.804871 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d578d678-f61c-40f8-8f53-2359e4a1c34d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.259193 Aug 24 05:45:55.805447 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 101/198] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:55 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:56.829013 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9f136a21-aa4b-4cb3-850f-88eada518c0e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:56.829783 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9f136a21-aa4b-4cb3-850f-88eada518c0e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:56.842319 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f136a21-aa4b-4cb3-850f-88eada518c0e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:56.843212 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f136a21-aa4b-4cb3-850f-88eada518c0e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:56.844170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f136a21-aa4b-4cb3-850f-88eada518c0e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:56.845839 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f136a21-aa4b-4cb3-850f-88eada518c0e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:56.847334 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f136a21-aa4b-4cb3-850f-88eada518c0e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:56.848267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f136a21-aa4b-4cb3-850f-88eada518c0e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:57.013829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9f136a21-aa4b-4cb3-850f-88eada518c0e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:57.027907 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9f136a21-aa4b-4cb3-850f-88eada518c0e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.203653 Aug 24 05:45:57.028992 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 98/199] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:56 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:58.050989 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-31bd8eb2-a31a-4ff8-b00c-d571539a1f37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:58.051712 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-31bd8eb2-a31a-4ff8-b00c-d571539a1f37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:58.057954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31bd8eb2-a31a-4ff8-b00c-d571539a1f37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:58.058439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31bd8eb2-a31a-4ff8-b00c-d571539a1f37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:58.058870 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31bd8eb2-a31a-4ff8-b00c-d571539a1f37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:58.059569 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31bd8eb2-a31a-4ff8-b00c-d571539a1f37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:58.060019 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31bd8eb2-a31a-4ff8-b00c-d571539a1f37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:58.063847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31bd8eb2-a31a-4ff8-b00c-d571539a1f37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:58.217639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-31bd8eb2-a31a-4ff8-b00c-d571539a1f37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:58.229238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-31bd8eb2-a31a-4ff8-b00c-d571539a1f37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.181981 Aug 24 05:45:58.229840 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 102/200] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:58 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:45:59.251389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6dfaf7b9-ef40-4acd-963a-6707e2f087ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:59.252021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6dfaf7b9-ef40-4acd-963a-6707e2f087ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:45:59.259089 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dfaf7b9-ef40-4acd-963a-6707e2f087ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:59.259558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dfaf7b9-ef40-4acd-963a-6707e2f087ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:59.259984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dfaf7b9-ef40-4acd-963a-6707e2f087ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:59.260766 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dfaf7b9-ef40-4acd-963a-6707e2f087ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:59.261242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dfaf7b9-ef40-4acd-963a-6707e2f087ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:59.261633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dfaf7b9-ef40-4acd-963a-6707e2f087ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:59.435170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6dfaf7b9-ef40-4acd-963a-6707e2f087ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:45:59.447167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6dfaf7b9-ef40-4acd-963a-6707e2f087ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.199467 Aug 24 05:45:59.448498 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 99/201] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:45:59 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:00.470439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0dbb02c1-9fd1-4987-9796-64fbadfe52e2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:00.471619 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0dbb02c1-9fd1-4987-9796-64fbadfe52e2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:00.483213 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0dbb02c1-9fd1-4987-9796-64fbadfe52e2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:00.485362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0dbb02c1-9fd1-4987-9796-64fbadfe52e2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:00.486063 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0dbb02c1-9fd1-4987-9796-64fbadfe52e2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:00.487138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0dbb02c1-9fd1-4987-9796-64fbadfe52e2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:00.488074 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0dbb02c1-9fd1-4987-9796-64fbadfe52e2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:00.488668 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0dbb02c1-9fd1-4987-9796-64fbadfe52e2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:00.624177 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-14617673-7144-4470-bd08-40c4e9785d63 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:00.625078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-14617673-7144-4470-bd08-40c4e9785d63 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:00.632536 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-14617673-7144-4470-bd08-40c4e9785d63 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:00.633041 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-14617673-7144-4470-bd08-40c4e9785d63 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:00.633477 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-14617673-7144-4470-bd08-40c4e9785d63 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:00.634284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-14617673-7144-4470-bd08-40c4e9785d63 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:00.634857 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-14617673-7144-4470-bd08-40c4e9785d63 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:00.635540 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-14617673-7144-4470-bd08-40c4e9785d63 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:00.689638 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-14617673-7144-4470-bd08-40c4e9785d63 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Going to try to terminate instance {{(pid=127756) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:46:00.701035 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0dbb02c1-9fd1-4987-9796-64fbadfe52e2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:00.722537 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0dbb02c1-9fd1-4987-9796-64fbadfe52e2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.256458 Aug 24 05:46:00.723455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 103/202] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:00 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:01.086022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1056565830", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "networks": [{"uuid": "caefaf7b-2ef5-4b4b-91a4-afe0dd0fe07f"}]}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:01.167152 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] validate_networks() for [('caefaf7b-2ef5-4b4b-91a4-afe0dd0fe07f', None, None, None, None, None)] {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:46:01.173380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-14617673-7144-4470-bd08-40c4e9785d63 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 204 len: 0 microversion: 2.1 time: 0.552950 Aug 24 05:46:01.174121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 100/203] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:46:00 2022] DELETE /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:46:01.184786 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8e038da1-45f0-4a3f-95bb-c753771e1e89 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:01.185851 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8e038da1-45f0-4a3f-95bb-c753771e1e89 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:01.193364 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e038da1-45f0-4a3f-95bb-c753771e1e89 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:01.193855 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e038da1-45f0-4a3f-95bb-c753771e1e89 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:01.194289 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e038da1-45f0-4a3f-95bb-c753771e1e89 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:01.194996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e038da1-45f0-4a3f-95bb-c753771e1e89 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:01.195441 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e038da1-45f0-4a3f-95bb-c753771e1e89 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:01.196043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e038da1-45f0-4a3f-95bb-c753771e1e89 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:01.707093 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8e038da1-45f0-4a3f-95bb-c753771e1e89 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:01.718535 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8e038da1-45f0-4a3f-95bb-c753771e1e89 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1554 microversion: 2.1 time: 0.538363 Aug 24 05:46:01.719600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 101/204] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:01 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1554 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:01.763473 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ae827831-6986-4471-bad3-9e37551c7ae0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:01.764290 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ae827831-6986-4471-bad3-9e37551c7ae0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:01.771389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae827831-6986-4471-bad3-9e37551c7ae0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:01.771879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae827831-6986-4471-bad3-9e37551c7ae0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:01.772361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae827831-6986-4471-bad3-9e37551c7ae0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:01.773154 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae827831-6986-4471-bad3-9e37551c7ae0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:01.773614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae827831-6986-4471-bad3-9e37551c7ae0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:01.774044 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae827831-6986-4471-bad3-9e37551c7ae0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:01.975033 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:46:01.975852 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:46:01.975989 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:46:01.976332 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:46:01.976772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:46:01.987930 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:01.988460 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:01.988876 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:01.989625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:01.990077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:01.990581 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:02.016144 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Getting quotas for project 43149d6590a6468b83faa5f1cd7c6b59. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:02.016354 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ae827831-6986-4471-bad3-9e37551c7ae0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:02.017693 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Getting quotas for user 1c85840c4d104b04b6ed577cce2ca2ff and project 43149d6590a6468b83faa5f1cd7c6b59. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:02.024431 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ae827831-6986-4471-bad3-9e37551c7ae0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.264950 Aug 24 05:46:02.025492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 102/205] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:01 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:02.045842 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:46:02.052536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:46:02.335334 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b5224371-3a6f-4b8a-b1e1-3e6d7b457fdf tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258969 Aug 24 05:46:02.335938 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 104/206] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:46:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:46:02.347045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fc3a2804-b398-415f-8a4a-add864a8a1de tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:02.347740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-fc3a2804-b398-415f-8a4a-add864a8a1de tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:02.410154 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-fc3a2804-b398-415f-8a4a-add864a8a1de tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:02.427242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-fc3a2804-b398-415f-8a4a-add864a8a1de tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1214 microversion: 2.1 time: 0.081935 Aug 24 05:46:02.432589 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 103/207] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:02 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:02.743613 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8644abd5-8267-4318-ae0d-5294aa77bea4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:02.744542 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8644abd5-8267-4318-ae0d-5294aa77bea4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:02.751701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8644abd5-8267-4318-ae0d-5294aa77bea4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:02.752238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8644abd5-8267-4318-ae0d-5294aa77bea4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:02.753263 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8644abd5-8267-4318-ae0d-5294aa77bea4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:02.753929 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8644abd5-8267-4318-ae0d-5294aa77bea4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:02.754380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8644abd5-8267-4318-ae0d-5294aa77bea4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:02.754802 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8644abd5-8267-4318-ae0d-5294aa77bea4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:02.897152 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8644abd5-8267-4318-ae0d-5294aa77bea4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:02.910322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8644abd5-8267-4318-ae0d-5294aa77bea4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1554 microversion: 2.1 time: 0.171063 Aug 24 05:46:02.924681 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 105/208] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:02 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:03.046800 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a20068ba-1345-48a3-9929-d38d6772dbfd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:03.047532 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a20068ba-1345-48a3-9929-d38d6772dbfd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:03.055932 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a20068ba-1345-48a3-9929-d38d6772dbfd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:03.056461 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a20068ba-1345-48a3-9929-d38d6772dbfd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:03.056914 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a20068ba-1345-48a3-9929-d38d6772dbfd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:03.057635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a20068ba-1345-48a3-9929-d38d6772dbfd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:03.058425 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a20068ba-1345-48a3-9929-d38d6772dbfd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:03.058622 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a20068ba-1345-48a3-9929-d38d6772dbfd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:03.234896 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a20068ba-1345-48a3-9929-d38d6772dbfd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:03.254121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a20068ba-1345-48a3-9929-d38d6772dbfd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.211191 Aug 24 05:46:03.254722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 104/209] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:03 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:03.472317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b4984ad3-0734-400a-be81-ce0e7cfe1c12 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:03.473067 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b4984ad3-0734-400a-be81-ce0e7cfe1c12 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:03.548168 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b4984ad3-0734-400a-be81-ce0e7cfe1c12 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:03.556882 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b4984ad3-0734-400a-be81-ce0e7cfe1c12 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1214 microversion: 2.1 time: 0.089248 Aug 24 05:46:03.557573 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 106/210] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:03 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:03.940086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b9364153-bb58-4b6f-8127-08fa7b0f330f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:03.941002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b9364153-bb58-4b6f-8127-08fa7b0f330f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:03.949219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9364153-bb58-4b6f-8127-08fa7b0f330f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:03.949745 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9364153-bb58-4b6f-8127-08fa7b0f330f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:03.950391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9364153-bb58-4b6f-8127-08fa7b0f330f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:03.951082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9364153-bb58-4b6f-8127-08fa7b0f330f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:03.951607 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9364153-bb58-4b6f-8127-08fa7b0f330f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:03.952029 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9364153-bb58-4b6f-8127-08fa7b0f330f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:04.149245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b9364153-bb58-4b6f-8127-08fa7b0f330f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:04.160925 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b9364153-bb58-4b6f-8127-08fa7b0f330f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1554 microversion: 2.1 time: 0.225145 Aug 24 05:46:04.161544 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 105/211] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:03 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:04.277446 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c87ab4d8-e94a-4e44-89eb-ea0b47fe8645 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:04.278060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c87ab4d8-e94a-4e44-89eb-ea0b47fe8645 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:04.287103 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c87ab4d8-e94a-4e44-89eb-ea0b47fe8645 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:04.288003 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c87ab4d8-e94a-4e44-89eb-ea0b47fe8645 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:04.288532 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c87ab4d8-e94a-4e44-89eb-ea0b47fe8645 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:04.289876 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c87ab4d8-e94a-4e44-89eb-ea0b47fe8645 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:04.290787 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c87ab4d8-e94a-4e44-89eb-ea0b47fe8645 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:04.291731 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c87ab4d8-e94a-4e44-89eb-ea0b47fe8645 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:04.495447 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c87ab4d8-e94a-4e44-89eb-ea0b47fe8645 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:04.510327 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c87ab4d8-e94a-4e44-89eb-ea0b47fe8645 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.237776 Aug 24 05:46:04.510920 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 107/212] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:04 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:04.579267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1a472fcd-723d-4464-9a03-d5e1a30c0844 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:04.581421 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1a472fcd-723d-4464-9a03-d5e1a30c0844 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:04.597113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a472fcd-723d-4464-9a03-d5e1a30c0844 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:04.597620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a472fcd-723d-4464-9a03-d5e1a30c0844 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:04.598064 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a472fcd-723d-4464-9a03-d5e1a30c0844 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:04.598779 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a472fcd-723d-4464-9a03-d5e1a30c0844 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:04.599239 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a472fcd-723d-4464-9a03-d5e1a30c0844 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:04.599666 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a472fcd-723d-4464-9a03-d5e1a30c0844 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:04.671015 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1a472fcd-723d-4464-9a03-d5e1a30c0844 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:04.680164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1a472fcd-723d-4464-9a03-d5e1a30c0844 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1210 microversion: 2.1 time: 0.104747 Aug 24 05:46:04.680790 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 106/213] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:04 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:05.187235 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-23dcb286-eaec-4f47-8e88-164480d103a4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:05.187864 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-23dcb286-eaec-4f47-8e88-164480d103a4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:05.196426 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23dcb286-eaec-4f47-8e88-164480d103a4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:05.196937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23dcb286-eaec-4f47-8e88-164480d103a4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:05.197966 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23dcb286-eaec-4f47-8e88-164480d103a4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:05.198472 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23dcb286-eaec-4f47-8e88-164480d103a4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:05.198946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23dcb286-eaec-4f47-8e88-164480d103a4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:05.199379 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23dcb286-eaec-4f47-8e88-164480d103a4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:05.423149 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-23dcb286-eaec-4f47-8e88-164480d103a4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:05.440342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-23dcb286-eaec-4f47-8e88-164480d103a4 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1554 microversion: 2.1 time: 0.257454 Aug 24 05:46:05.441463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 108/214] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:05 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1554 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:05.535498 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ba89a10f-f13e-47cd-9701-533378e2010a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:05.537861 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ba89a10f-f13e-47cd-9701-533378e2010a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:05.545610 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba89a10f-f13e-47cd-9701-533378e2010a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:05.546458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba89a10f-f13e-47cd-9701-533378e2010a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:05.547591 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba89a10f-f13e-47cd-9701-533378e2010a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:05.548619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba89a10f-f13e-47cd-9701-533378e2010a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:05.550247 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba89a10f-f13e-47cd-9701-533378e2010a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:05.550865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba89a10f-f13e-47cd-9701-533378e2010a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:05.721406 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c25db260-f42f-4731-bfb2-9865cba8dd62 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:05.728614 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c25db260-f42f-4731-bfb2-9865cba8dd62 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:05.756621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c25db260-f42f-4731-bfb2-9865cba8dd62 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:05.757948 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c25db260-f42f-4731-bfb2-9865cba8dd62 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:05.776930 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c25db260-f42f-4731-bfb2-9865cba8dd62 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:05.778741 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c25db260-f42f-4731-bfb2-9865cba8dd62 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:05.781323 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c25db260-f42f-4731-bfb2-9865cba8dd62 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:05.789282 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c25db260-f42f-4731-bfb2-9865cba8dd62 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:05.899252 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ba89a10f-f13e-47cd-9701-533378e2010a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:05.921658 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ba89a10f-f13e-47cd-9701-533378e2010a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.390334 Aug 24 05:46:05.946303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 107/215] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:05 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:05.954182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-7a9f458c-4b02-4731-bbdb-fa1b6b7d0fb2 req-f2a60cc3-6eb7-4bb2-8400-c974cc48af44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ebc8e1-e92d-4891-9d63-7a24cb4f9536", "name": "network-vif-deleted", "tag": "13810f52-c423-464f-b3c5-0aa15c6ac45a"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:05.983224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-7a9f458c-4b02-4731-bbdb-fa1b6b7d0fb2 req-f2a60cc3-6eb7-4bb2-8400-c974cc48af44 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:05.983224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-7a9f458c-4b02-4731-bbdb-fa1b6b7d0fb2 req-f2a60cc3-6eb7-4bb2-8400-c974cc48af44 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:05.983224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-7a9f458c-4b02-4731-bbdb-fa1b6b7d0fb2 req-f2a60cc3-6eb7-4bb2-8400-c974cc48af44 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:05.989396 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c25db260-f42f-4731-bfb2-9865cba8dd62 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:05.998443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c25db260-f42f-4731-bfb2-9865cba8dd62 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1266 microversion: 2.1 time: 0.295527 Aug 24 05:46:05.999459 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 109/216] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:05 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:06.000464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-7a9f458c-4b02-4731-bbdb-fa1b6b7d0fb2 req-f2a60cc3-6eb7-4bb2-8400-c974cc48af44 service nova] Creating event network-vif-deleted:13810f52-c423-464f-b3c5-0aa15c6ac45a for instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 on hv-cinder-85426 Aug 24 05:46:06.018095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-7a9f458c-4b02-4731-bbdb-fa1b6b7d0fb2 req-f2a60cc3-6eb7-4bb2-8400-c974cc48af44 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069598 Aug 24 05:46:06.019924 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 108/217] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:06.468078 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-07cd4adf-2d87-4fc1-a1de-4365be28e11f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:06.468767 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-07cd4adf-2d87-4fc1-a1de-4365be28e11f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:06.479359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cd4adf-2d87-4fc1-a1de-4365be28e11f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:06.479850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cd4adf-2d87-4fc1-a1de-4365be28e11f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:06.480544 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cd4adf-2d87-4fc1-a1de-4365be28e11f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:06.482173 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cd4adf-2d87-4fc1-a1de-4365be28e11f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:06.482814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cd4adf-2d87-4fc1-a1de-4365be28e11f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:06.483403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cd4adf-2d87-4fc1-a1de-4365be28e11f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:06.582359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-07cd4adf-2d87-4fc1-a1de-4365be28e11f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:06.592671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-07cd4adf-2d87-4fc1-a1de-4365be28e11f tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1346 microversion: 2.1 time: 0.131338 Aug 24 05:46:06.605461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 110/218] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:06 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:06.969903 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-02102625-f8bc-4e5f-ad53-d3644fc07451 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:06.971244 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-02102625-f8bc-4e5f-ad53-d3644fc07451 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:07.001310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:07.007729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02102625-f8bc-4e5f-ad53-d3644fc07451 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:07.008308 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02102625-f8bc-4e5f-ad53-d3644fc07451 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:07.010285 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02102625-f8bc-4e5f-ad53-d3644fc07451 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:07.013721 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02102625-f8bc-4e5f-ad53-d3644fc07451 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:07.015644 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02102625-f8bc-4e5f-ad53-d3644fc07451 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:07.023781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02102625-f8bc-4e5f-ad53-d3644fc07451 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:07.027119 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-416e2504-c748-4b30-a971-82721725bca3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:07.027744 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-416e2504-c748-4b30-a971-82721725bca3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:07.048673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-416e2504-c748-4b30-a971-82721725bca3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:07.052974 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-416e2504-c748-4b30-a971-82721725bca3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:07.054661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-416e2504-c748-4b30-a971-82721725bca3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:07.056886 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-416e2504-c748-4b30-a971-82721725bca3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:07.057740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-416e2504-c748-4b30-a971-82721725bca3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:07.058432 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-416e2504-c748-4b30-a971-82721725bca3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:07.350881 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-02102625-f8bc-4e5f-ad53-d3644fc07451 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:07.385872 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-416e2504-c748-4b30-a971-82721725bca3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:07.394783 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-416e2504-c748-4b30-a971-82721725bca3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1314 microversion: 2.1 time: 0.374652 Aug 24 05:46:07.398789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-02102625-f8bc-4e5f-ad53-d3644fc07451 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.439580 Aug 24 05:46:07.400254 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 109/219] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:06 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:07.415043 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 111/220] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:07 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:07.619186 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:07.619841 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:07.628716 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:07.629213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:07.629646 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:07.630434 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:07.630780 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:07.631368 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:07.678915 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:07.686930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:07.686930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:07.686930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lazy-loading 'fault' on Instance uuid f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:46:07.734134 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bda9f6f00c74112a54573c3905ad1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb377db175354cac93e5ff6579af3e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:07.738190 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:07.750082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-11cc20ac-13e6-4c48-9b04-a08eb29d4383 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 200 len: 1351 microversion: 2.1 time: 0.138606 Aug 24 05:46:07.752162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 110/221] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:07 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 1351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:08.422532 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b4b9c960-0c68-401d-a288-1d4e6627378b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:08.423142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b4b9c960-0c68-401d-a288-1d4e6627378b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:08.430423 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b4b9c960-0c68-401d-a288-1d4e6627378b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.430798 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b4b9c960-0c68-401d-a288-1d4e6627378b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.431241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b4b9c960-0c68-401d-a288-1d4e6627378b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.431950 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b4b9c960-0c68-401d-a288-1d4e6627378b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.432433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b4b9c960-0c68-401d-a288-1d4e6627378b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.432868 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b4b9c960-0c68-401d-a288-1d4e6627378b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.445416 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-79a1eaea-1489-4f3a-9646-b5c3c66b639a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:08.446634 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-79a1eaea-1489-4f3a-9646-b5c3c66b639a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:08.454280 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79a1eaea-1489-4f3a-9646-b5c3c66b639a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.459110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79a1eaea-1489-4f3a-9646-b5c3c66b639a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.459110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79a1eaea-1489-4f3a-9646-b5c3c66b639a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.459110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79a1eaea-1489-4f3a-9646-b5c3c66b639a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.459110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79a1eaea-1489-4f3a-9646-b5c3c66b639a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.459914 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79a1eaea-1489-4f3a-9646-b5c3c66b639a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.833691 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b4b9c960-0c68-401d-a288-1d4e6627378b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:08.838869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-79a1eaea-1489-4f3a-9646-b5c3c66b639a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:08.852063 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-79a1eaea-1489-4f3a-9646-b5c3c66b639a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1314 microversion: 2.1 time: 0.411236 Aug 24 05:46:08.853256 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 111/222] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:08 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:08.856508 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b4b9c960-0c68-401d-a288-1d4e6627378b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.437917 Aug 24 05:46:08.866460 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-78b7fa74-4ced-4c01-891b-efcd06020cf8 req-6de441e6-2cf2-4c7b-977a-5ea217d873e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c853b4f-d418-48a3-9ee7-56fda639a2a8", "tag": "a2cde1a2-7475-4c77-a36a-ca4198244f5d"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:08.867720 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 112/223] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:08 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:08.874655 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:08.876486 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:08.882992 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.883766 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.884446 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.885355 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.885821 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.886251 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.887400 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-78b7fa74-4ced-4c01-891b-efcd06020cf8 req-6de441e6-2cf2-4c7b-977a-5ea217d873e3 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.887896 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-78b7fa74-4ced-4c01-891b-efcd06020cf8 req-6de441e6-2cf2-4c7b-977a-5ea217d873e3 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.888335 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-78b7fa74-4ced-4c01-891b-efcd06020cf8 req-6de441e6-2cf2-4c7b-977a-5ea217d873e3 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.912481 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] HTTP exception thrown: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:08.913815 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-78b7fa74-4ced-4c01-891b-efcd06020cf8 req-6de441e6-2cf2-4c7b-977a-5ea217d873e3 service nova] Creating event network-changed:a2cde1a2-7475-4c77-a36a-ca4198244f5d for instance 9c853b4f-d418-48a3-9ee7-56fda639a2a8 on hv-cinder-85426 Aug 24 05:46:08.919507 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-78b7fa74-4ced-4c01-891b-efcd06020cf8 req-6de441e6-2cf2-4c7b-977a-5ea217d873e3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064880 Aug 24 05:46:08.920116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 112/224] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Request method failure captured: Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 HTTP/1.1 Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbrFRLE_DWh2zC8kciY0_EcfI09TldKMOWwqbIlKjxHXJWsByuk1-y1M34PQGCvGW5ukKnvIHCVVsWBYofl9jSR08uumg67KSm5TgGW5ZLLqGdNta7E3V5AGSbiJA_UEjH7EDXyN5eDE4qmT-iPUu4lkY13uqri-5fe5UDa1qCcL8o0 Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: eb377db175354cac93e5ff6579af3e3e Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:46:08.921961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb377db175354cac93e5ff6579af3e3e"}]}] Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: eb377db175354cac93e5ff6579af3e3e Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-DeleteServersTestJSON-2077646364-project Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: 9bda9f6f00c74112a54573c3905ad1bf Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-DeleteServersTestJSON-2077646364-project Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:08.923430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': 'f7ebc8e1-e92d-4891-9d63-7a24cb4f9536'} Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:46:08.924362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:08.926002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:46:08.928580 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Returning 404 to user: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:46:08.929720 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-07cf83ac-9ad2-4034-9201-9290d9754b9d tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 404 len: 111 microversion: 2.1 time: 0.059715 Aug 24 05:46:08.930588 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 113/225] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:08 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:46:09.118206 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:09.121174 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:09.130982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:09.131770 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:09.132445 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:09.133393 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:09.134052 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:09.134866 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:09.154750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] HTTP exception thrown: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Request method failure captured: Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536/os-volume_attachments HTTP/1.1 Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrFRLE_DWh2zC8kciY0_EcfI09TldKMOWwqbIlKjxHXJWsByuk1-y1M34PQGCvGW5ukKnvIHCVVsWBYofl9jSR08uumg67KSm5TgGW5ZLLqGdNta7E3V5AGSbiJA_UEjH7EDXyN5eDE4qmT-iPUu4lkY13uqri-5fe5UDa1qCcL8o0 Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: eb377db175354cac93e5ff6579af3e3e Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:46:09.164871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb377db175354cac93e5ff6579af3e3e"}]}] Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: eb377db175354cac93e5ff6579af3e3e Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-DeleteServersTestJSON-2077646364-project Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 9bda9f6f00c74112a54573c3905ad1bf Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-DeleteServersTestJSON-2077646364-project Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:09.166578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'server_id': 'f7ebc8e1-e92d-4891-9d63-7a24cb4f9536'} Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:46:09.167294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:09.168353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:09.171045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Returning 404 to user: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:46:09.176077 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5c7c99e5-cad5-4a8f-9e4c-7ec4dcd3a1c9 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.061718 Aug 24 05:46:09.177060 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 113/226] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:46:09 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:46:09.874678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f358bc08-827e-4c05-9412-af5547eb6231 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:09.875422 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f358bc08-827e-4c05-9412-af5547eb6231 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:09.878827 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:09.882444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fc96f9fe-be67-4d69-999d-7700c2ee662c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:09.883180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-fc96f9fe-be67-4d69-999d-7700c2ee662c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:09.884674 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f358bc08-827e-4c05-9412-af5547eb6231 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:09.885166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f358bc08-827e-4c05-9412-af5547eb6231 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:09.885607 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f358bc08-827e-4c05-9412-af5547eb6231 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:09.886684 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f358bc08-827e-4c05-9412-af5547eb6231 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:09.886792 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f358bc08-827e-4c05-9412-af5547eb6231 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:09.887164 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f358bc08-827e-4c05-9412-af5547eb6231 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:09.890341 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc96f9fe-be67-4d69-999d-7700c2ee662c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:09.890829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc96f9fe-be67-4d69-999d-7700c2ee662c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:09.891454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc96f9fe-be67-4d69-999d-7700c2ee662c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:09.892177 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc96f9fe-be67-4d69-999d-7700c2ee662c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:09.892688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc96f9fe-be67-4d69-999d-7700c2ee662c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:09.893765 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc96f9fe-be67-4d69-999d-7700c2ee662c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.100157 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f358bc08-827e-4c05-9412-af5547eb6231 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:10.115744 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f358bc08-827e-4c05-9412-af5547eb6231 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1314 microversion: 2.1 time: 0.245489 Aug 24 05:46:10.116487 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 114/227] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:09 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:10.118875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-fc96f9fe-be67-4d69-999d-7700c2ee662c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:10.128862 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-fc96f9fe-be67-4d69-999d-7700c2ee662c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.251477 Aug 24 05:46:10.129516 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 114/228] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:09 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:10.855934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:10.856835 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:10.866594 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.871304 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.871304 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.871304 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.871304 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.871906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.885223 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] HTTP exception thrown: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Request method failure captured: Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: DELETE /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 HTTP/1.1 Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbrFRLE_DWh2zC8kciY0_EcfI09TldKMOWwqbIlKjxHXJWsByuk1-y1M34PQGCvGW5ukKnvIHCVVsWBYofl9jSR08uumg67KSm5TgGW5ZLLqGdNta7E3V5AGSbiJA_UEjH7EDXyN5eDE4qmT-iPUu4lkY13uqri-5fe5UDa1qCcL8o0 Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: eb377db175354cac93e5ff6579af3e3e Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:46:10.886824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb377db175354cac93e5ff6579af3e3e"}]}] Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: eb377db175354cac93e5ff6579af3e3e Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-DeleteServersTestJSON-2077646364-project Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: 9bda9f6f00c74112a54573c3905ad1bf Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-DeleteServersTestJSON-2077646364-project Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:10.893124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': 'f7ebc8e1-e92d-4891-9d63-7a24cb4f9536'} Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:46:10.893853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:10.895420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:46:10.902462 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Returning 404 to user: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:46:10.902462 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ae6492cc-7f1b-4c8a-8176-76a95c4cea96 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 404 len: 111 microversion: 2.1 time: 0.037309 Aug 24 05:46:10.902462 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 115/229] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:46:10 2022] DELETE /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:46:10.902705 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:10.902705 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] [instance: f7ebc8e1-e92d-4891-9d63-7a24cb4f9536] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:10.910400 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.910958 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.911408 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.912331 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.913139 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.913850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.945104 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] HTTP exception thrown: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Request method failure captured: Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 HTTP/1.1 Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrFRLE_DWh2zC8kciY0_EcfI09TldKMOWwqbIlKjxHXJWsByuk1-y1M34PQGCvGW5ukKnvIHCVVsWBYofl9jSR08uumg67KSm5TgGW5ZLLqGdNta7E3V5AGSbiJA_UEjH7EDXyN5eDE4qmT-iPUu4lkY13uqri-5fe5UDa1qCcL8o0 Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: eb377db175354cac93e5ff6579af3e3e Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:46:10.953005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb377db175354cac93e5ff6579af3e3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb377db175354cac93e5ff6579af3e3e"}]}] Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: eb377db175354cac93e5ff6579af3e3e Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-DeleteServersTestJSON-2077646364 Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-DeleteServersTestJSON-2077646364-project Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 9bda9f6f00c74112a54573c3905ad1bf Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-DeleteServersTestJSON-2077646364-project Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:10.959105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': 'f7ebc8e1-e92d-4891-9d63-7a24cb4f9536'} Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:46:10.959769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. Aug 24 05:46:10.960858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:10.962004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] Returning 404 to user: Instance f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:46:10.962004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a2da2b3a-85b1-4890-8f2b-183d43f20492 tempest-DeleteServersTestJSON-2077646364 tempest-DeleteServersTestJSON-2077646364-project] 10.222.0.15 "GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536" status: 404 len: 111 microversion: 2.1 time: 0.060073 Aug 24 05:46:10.962004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 115/230] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:10 2022] GET /compute/v2.1/servers/f7ebc8e1-e92d-4891-9d63-7a24cb4f9536 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:46:11.142358 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7dcc26ad-0508-4e6d-8e34-d4abbe994c18 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:11.144978 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7dcc26ad-0508-4e6d-8e34-d4abbe994c18 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:11.151216 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2834e050-d144-4c68-bf4b-e89244240b81 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:11.152063 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2834e050-d144-4c68-bf4b-e89244240b81 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:11.155481 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dcc26ad-0508-4e6d-8e34-d4abbe994c18 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:11.156032 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dcc26ad-0508-4e6d-8e34-d4abbe994c18 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:11.156633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dcc26ad-0508-4e6d-8e34-d4abbe994c18 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:11.157371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dcc26ad-0508-4e6d-8e34-d4abbe994c18 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:11.157832 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dcc26ad-0508-4e6d-8e34-d4abbe994c18 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:11.159182 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dcc26ad-0508-4e6d-8e34-d4abbe994c18 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:11.162853 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2834e050-d144-4c68-bf4b-e89244240b81 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:11.164088 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2834e050-d144-4c68-bf4b-e89244240b81 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:11.165084 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2834e050-d144-4c68-bf4b-e89244240b81 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:11.166716 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2834e050-d144-4c68-bf4b-e89244240b81 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:11.168206 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2834e050-d144-4c68-bf4b-e89244240b81 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:11.169147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2834e050-d144-4c68-bf4b-e89244240b81 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:11.560740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7dcc26ad-0508-4e6d-8e34-d4abbe994c18 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:11.566573 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7dcc26ad-0508-4e6d-8e34-d4abbe994c18 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1314 microversion: 2.1 time: 0.430674 Aug 24 05:46:11.567518 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 116/231] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:11 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:11.593316 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2834e050-d144-4c68-bf4b-e89244240b81 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:11.603142 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2834e050-d144-4c68-bf4b-e89244240b81 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.456822 Aug 24 05:46:11.604006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 116/232] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:11 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:12.589191 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b1bf2c9d-cfda-4da3-b661-d07e955e234c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:12.589872 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b1bf2c9d-cfda-4da3-b661-d07e955e234c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:12.593166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:12.599903 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bf2c9d-cfda-4da3-b661-d07e955e234c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:12.602229 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bf2c9d-cfda-4da3-b661-d07e955e234c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:12.602975 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bf2c9d-cfda-4da3-b661-d07e955e234c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:12.604003 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bf2c9d-cfda-4da3-b661-d07e955e234c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:12.604749 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bf2c9d-cfda-4da3-b661-d07e955e234c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:12.605471 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bf2c9d-cfda-4da3-b661-d07e955e234c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:12.627943 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-efb0bb8d-0e85-438f-b596-ce4f85f1c4b6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:12.629482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-efb0bb8d-0e85-438f-b596-ce4f85f1c4b6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:12.637031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:12.643214 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:12.651765 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-efb0bb8d-0e85-438f-b596-ce4f85f1c4b6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:12.652282 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-efb0bb8d-0e85-438f-b596-ce4f85f1c4b6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:12.652979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-efb0bb8d-0e85-438f-b596-ce4f85f1c4b6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:12.653877 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-efb0bb8d-0e85-438f-b596-ce4f85f1c4b6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:12.654495 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-efb0bb8d-0e85-438f-b596-ce4f85f1c4b6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:12.655073 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-efb0bb8d-0e85-438f-b596-ce4f85f1c4b6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:13.056493 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b1bf2c9d-cfda-4da3-b661-d07e955e234c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:13.064556 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b1bf2c9d-cfda-4da3-b661-d07e955e234c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1314 microversion: 2.1 time: 0.479910 Aug 24 05:46:13.077889 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 117/233] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:12 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:13.097136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-efb0bb8d-0e85-438f-b596-ce4f85f1c4b6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:13.128031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-efb0bb8d-0e85-438f-b596-ce4f85f1c4b6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.505396 Aug 24 05:46:13.132755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 117/234] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:12 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:14.099213 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b249eec6-fb51-4e51-9881-e990aeedf6a6 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:14.099842 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b249eec6-fb51-4e51-9881-e990aeedf6a6 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:14.102412 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=8 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:14.116740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b249eec6-fb51-4e51-9881-e990aeedf6a6 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.117239 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b249eec6-fb51-4e51-9881-e990aeedf6a6 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.117672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b249eec6-fb51-4e51-9881-e990aeedf6a6 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.118383 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b249eec6-fb51-4e51-9881-e990aeedf6a6 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.118836 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b249eec6-fb51-4e51-9881-e990aeedf6a6 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.119344 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b249eec6-fb51-4e51-9881-e990aeedf6a6 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.150872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2adf7780-ee03-42f3-83f8-ca05a6a551e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:14.151482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2adf7780-ee03-42f3-83f8-ca05a6a551e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:14.167582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2adf7780-ee03-42f3-83f8-ca05a6a551e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.171106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2adf7780-ee03-42f3-83f8-ca05a6a551e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.171970 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2adf7780-ee03-42f3-83f8-ca05a6a551e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.173057 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2adf7780-ee03-42f3-83f8-ca05a6a551e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.177740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2adf7780-ee03-42f3-83f8-ca05a6a551e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.179325 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2adf7780-ee03-42f3-83f8-ca05a6a551e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.407447 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b249eec6-fb51-4e51-9881-e990aeedf6a6 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:14.417951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2adf7780-ee03-42f3-83f8-ca05a6a551e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:14.426825 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b249eec6-fb51-4e51-9881-e990aeedf6a6 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1314 microversion: 2.1 time: 0.331900 Aug 24 05:46:14.427172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2adf7780-ee03-42f3-83f8-ca05a6a551e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.280263 Aug 24 05:46:14.427764 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 118/235] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:14 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:14.428027 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 118/236] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:14 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:15.243401 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-e0e30b93-a0d4-48f7-a152-ec51664d68b0 req-6561750e-e7db-410b-a222-a27a5a1d05c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c853b4f-d418-48a3-9ee7-56fda639a2a8", "name": "network-vif-plugged", "status": "completed", "tag": "a2cde1a2-7475-4c77-a36a-ca4198244f5d"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:15.259019 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-e0e30b93-a0d4-48f7-a152-ec51664d68b0 req-6561750e-e7db-410b-a222-a27a5a1d05c2 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.259503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-e0e30b93-a0d4-48f7-a152-ec51664d68b0 req-6561750e-e7db-410b-a222-a27a5a1d05c2 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.259940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-e0e30b93-a0d4-48f7-a152-ec51664d68b0 req-6561750e-e7db-410b-a222-a27a5a1d05c2 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.273148 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-e0e30b93-a0d4-48f7-a152-ec51664d68b0 req-6561750e-e7db-410b-a222-a27a5a1d05c2 service nova] Creating event network-vif-plugged:a2cde1a2-7475-4c77-a36a-ca4198244f5d for instance 9c853b4f-d418-48a3-9ee7-56fda639a2a8 on hv-cinder-85426 Aug 24 05:46:15.278411 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-e0e30b93-a0d4-48f7-a152-ec51664d68b0 req-6561750e-e7db-410b-a222-a27a5a1d05c2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038772 Aug 24 05:46:15.279047 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 119/237] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:15.450163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ff2d2182-3f0f-49a6-b8b8-d4a65f834c2f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:15.450924 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ff2d2182-3f0f-49a6-b8b8-d4a65f834c2f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:15.463098 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ecba8750-5985-4955-b72e-a182796def8f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:15.464365 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ecba8750-5985-4955-b72e-a182796def8f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:15.464612 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ff2d2182-3f0f-49a6-b8b8-d4a65f834c2f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.466417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ff2d2182-3f0f-49a6-b8b8-d4a65f834c2f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.467123 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ff2d2182-3f0f-49a6-b8b8-d4a65f834c2f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.468075 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ff2d2182-3f0f-49a6-b8b8-d4a65f834c2f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.471894 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ff2d2182-3f0f-49a6-b8b8-d4a65f834c2f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.472660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ff2d2182-3f0f-49a6-b8b8-d4a65f834c2f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.485639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ecba8750-5985-4955-b72e-a182796def8f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.488165 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ecba8750-5985-4955-b72e-a182796def8f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.488165 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ecba8750-5985-4955-b72e-a182796def8f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.489183 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ecba8750-5985-4955-b72e-a182796def8f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.490498 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ecba8750-5985-4955-b72e-a182796def8f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.490684 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ecba8750-5985-4955-b72e-a182796def8f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.917486 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ff2d2182-3f0f-49a6-b8b8-d4a65f834c2f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:15.930754 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ff2d2182-3f0f-49a6-b8b8-d4a65f834c2f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.485598 Aug 24 05:46:15.934887 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 119/238] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:15 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:15.988676 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ecba8750-5985-4955-b72e-a182796def8f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:16.012020 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ecba8750-5985-4955-b72e-a182796def8f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1314 microversion: 2.1 time: 0.565505 Aug 24 05:46:16.013891 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 120/239] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:15 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:16.971768 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b00d97c3-4dc1-4328-9c4b-8cdff0f06d73 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:16.972416 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b00d97c3-4dc1-4328-9c4b-8cdff0f06d73 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:16.978584 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b00d97c3-4dc1-4328-9c4b-8cdff0f06d73 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:16.979076 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b00d97c3-4dc1-4328-9c4b-8cdff0f06d73 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:16.979695 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b00d97c3-4dc1-4328-9c4b-8cdff0f06d73 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:16.980419 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b00d97c3-4dc1-4328-9c4b-8cdff0f06d73 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:16.981126 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b00d97c3-4dc1-4328-9c4b-8cdff0f06d73 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:16.981633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b00d97c3-4dc1-4328-9c4b-8cdff0f06d73 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:17.036524 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-17a20847-0057-4c94-8094-9f60a825dcb5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:17.036524 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-17a20847-0057-4c94-8094-9f60a825dcb5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:17.043680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-17a20847-0057-4c94-8094-9f60a825dcb5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:17.044307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-17a20847-0057-4c94-8094-9f60a825dcb5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:17.044935 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-17a20847-0057-4c94-8094-9f60a825dcb5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:17.045656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-17a20847-0057-4c94-8094-9f60a825dcb5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:17.046116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-17a20847-0057-4c94-8094-9f60a825dcb5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:17.046551 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-17a20847-0057-4c94-8094-9f60a825dcb5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:17.215607 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b00d97c3-4dc1-4328-9c4b-8cdff0f06d73 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:17.225830 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b00d97c3-4dc1-4328-9c4b-8cdff0f06d73 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.258798 Aug 24 05:46:17.227850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 120/240] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:16 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:17.267278 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-17a20847-0057-4c94-8094-9f60a825dcb5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:17.278245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-17a20847-0057-4c94-8094-9f60a825dcb5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1314 microversion: 2.1 time: 0.246728 Aug 24 05:46:17.279011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 121/241] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:17 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:18.265499 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-cedb7343-a747-49a5-a4b0-bd5ef5c68af6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:18.268415 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-cedb7343-a747-49a5-a4b0-bd5ef5c68af6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:18.272625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cedb7343-a747-49a5-a4b0-bd5ef5c68af6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:18.273071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cedb7343-a747-49a5-a4b0-bd5ef5c68af6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:18.273514 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cedb7343-a747-49a5-a4b0-bd5ef5c68af6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:18.274200 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cedb7343-a747-49a5-a4b0-bd5ef5c68af6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:18.274653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cedb7343-a747-49a5-a4b0-bd5ef5c68af6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:18.275078 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cedb7343-a747-49a5-a4b0-bd5ef5c68af6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:18.303110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-87fa692e-20d2-4b86-a11f-e95588731f8a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:18.303546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-87fa692e-20d2-4b86-a11f-e95588731f8a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:18.315709 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-87fa692e-20d2-4b86-a11f-e95588731f8a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:18.316745 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-87fa692e-20d2-4b86-a11f-e95588731f8a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:18.317374 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-87fa692e-20d2-4b86-a11f-e95588731f8a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:18.318276 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-87fa692e-20d2-4b86-a11f-e95588731f8a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:18.318896 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-87fa692e-20d2-4b86-a11f-e95588731f8a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:18.319561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-87fa692e-20d2-4b86-a11f-e95588731f8a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:18.512714 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-cedb7343-a747-49a5-a4b0-bd5ef5c68af6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:18.517017 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-87fa692e-20d2-4b86-a11f-e95588731f8a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:18.534388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-cedb7343-a747-49a5-a4b0-bd5ef5c68af6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.266804 Aug 24 05:46:18.534388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 121/242] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:18 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:18.535970 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-87fa692e-20d2-4b86-a11f-e95588731f8a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1314 microversion: 2.1 time: 0.239941 Aug 24 05:46:18.536568 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 122/243] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:18 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:19.552994 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-02f38af2-6187-4428-9855-229e740aa154 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:19.553875 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-02f38af2-6187-4428-9855-229e740aa154 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:19.559284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fcbd4fa0-5d2a-469e-8fab-93325b4bfaba tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:19.560152 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02f38af2-6187-4428-9855-229e740aa154 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.560296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-fcbd4fa0-5d2a-469e-8fab-93325b4bfaba tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:19.564814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02f38af2-6187-4428-9855-229e740aa154 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.564814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02f38af2-6187-4428-9855-229e740aa154 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.564814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02f38af2-6187-4428-9855-229e740aa154 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.564814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02f38af2-6187-4428-9855-229e740aa154 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.565197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02f38af2-6187-4428-9855-229e740aa154 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.569009 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcbd4fa0-5d2a-469e-8fab-93325b4bfaba tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.569732 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcbd4fa0-5d2a-469e-8fab-93325b4bfaba tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.570627 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcbd4fa0-5d2a-469e-8fab-93325b4bfaba tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.571425 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcbd4fa0-5d2a-469e-8fab-93325b4bfaba tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.572155 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcbd4fa0-5d2a-469e-8fab-93325b4bfaba tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.572602 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcbd4fa0-5d2a-469e-8fab-93325b4bfaba tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.886678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-02f38af2-6187-4428-9855-229e740aa154 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:19.896318 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-fcbd4fa0-5d2a-469e-8fab-93325b4bfaba tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:19.899406 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-02f38af2-6187-4428-9855-229e740aa154 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.350826 Aug 24 05:46:19.906787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-fcbd4fa0-5d2a-469e-8fab-93325b4bfaba tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1499 microversion: 2.1 time: 0.352877 Aug 24 05:46:19.907485 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 123/244] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:19 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1499 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:19.912618 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 122/245] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:19 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:20.937873 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-38aafa2c-e277-41a1-99a2-b6e95a6882ec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:20.938932 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-38aafa2c-e277-41a1-99a2-b6e95a6882ec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:20.951853 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38aafa2c-e277-41a1-99a2-b6e95a6882ec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.952713 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38aafa2c-e277-41a1-99a2-b6e95a6882ec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.953577 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38aafa2c-e277-41a1-99a2-b6e95a6882ec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:20.954875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38aafa2c-e277-41a1-99a2-b6e95a6882ec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.955527 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38aafa2c-e277-41a1-99a2-b6e95a6882ec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.956034 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38aafa2c-e277-41a1-99a2-b6e95a6882ec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:21.227284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-38aafa2c-e277-41a1-99a2-b6e95a6882ec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:21.236117 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-38aafa2c-e277-41a1-99a2-b6e95a6882ec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.306010 Aug 24 05:46:21.237321 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 124/246] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:20 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:22.261406 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-622695f0-9125-4a1f-b664-ea102941c66b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:22.262343 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-622695f0-9125-4a1f-b664-ea102941c66b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:22.270400 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-622695f0-9125-4a1f-b664-ea102941c66b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:22.271034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-622695f0-9125-4a1f-b664-ea102941c66b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:22.275496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-622695f0-9125-4a1f-b664-ea102941c66b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:22.275496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-622695f0-9125-4a1f-b664-ea102941c66b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:22.275496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-622695f0-9125-4a1f-b664-ea102941c66b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:22.275496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-622695f0-9125-4a1f-b664-ea102941c66b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:22.803950 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-622695f0-9125-4a1f-b664-ea102941c66b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:22.829401 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-622695f0-9125-4a1f-b664-ea102941c66b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.570866 Aug 24 05:46:22.831804 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 123/247] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:22 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:23.871523 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-217ffb24-cd57-4ee6-9011-6adea6fdd29c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:23.872163 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-217ffb24-cd57-4ee6-9011-6adea6fdd29c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:23.882026 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-217ffb24-cd57-4ee6-9011-6adea6fdd29c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:23.882611 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-217ffb24-cd57-4ee6-9011-6adea6fdd29c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:23.883675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-217ffb24-cd57-4ee6-9011-6adea6fdd29c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:23.884566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-217ffb24-cd57-4ee6-9011-6adea6fdd29c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:23.885099 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-217ffb24-cd57-4ee6-9011-6adea6fdd29c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:23.885621 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-217ffb24-cd57-4ee6-9011-6adea6fdd29c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:24.048432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-217ffb24-cd57-4ee6-9011-6adea6fdd29c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:24.058360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-217ffb24-cd57-4ee6-9011-6adea6fdd29c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.192871 Aug 24 05:46:24.059034 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 125/248] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:23 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:25.082497 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-60d78588-2d88-42ca-b0f4-e3b232d65fcd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:25.094539 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-60d78588-2d88-42ca-b0f4-e3b232d65fcd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:25.106870 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-60d78588-2d88-42ca-b0f4-e3b232d65fcd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:25.107592 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-60d78588-2d88-42ca-b0f4-e3b232d65fcd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:25.108130 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-60d78588-2d88-42ca-b0f4-e3b232d65fcd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:25.108964 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-60d78588-2d88-42ca-b0f4-e3b232d65fcd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:25.109502 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-60d78588-2d88-42ca-b0f4-e3b232d65fcd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:25.110252 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-60d78588-2d88-42ca-b0f4-e3b232d65fcd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:25.320141 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-60d78588-2d88-42ca-b0f4-e3b232d65fcd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:25.333803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-60d78588-2d88-42ca-b0f4-e3b232d65fcd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.254112 Aug 24 05:46:25.333803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 124/249] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:25 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:25.834508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0b0fcc75-9952-4842-9d14-11bf82e62249 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Action: 'create', calling method: .version_select at 0x7f065c1db4c0>, body: {"keypair": {"name": "tempest-keypair-1482383248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmBBF4tgNDmHgP1S34BFyQc0oBno02cvFPWGy5rMTegnqyh6yBEXbuugW87C1kdYuLi99fmlU0CeKA99WCMeOEYzp3rBZdKD+eU5Be6TbHPULhrhztPj5QvPT25zprlLg=="}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:25.854623 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-0b0fcc75-9952-4842-9d14-11bf82e62249 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Getting quotas for project 56fbd96812654d16bbcf3522574a67eb. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:25.859568 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-0b0fcc75-9952-4842-9d14-11bf82e62249 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Getting quotas for user c7ef3bf8dfd342f5a2fef02bf597af90 and project 56fbd96812654d16bbcf3522574a67eb. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:25.958416 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0b0fcc75-9952-4842-9d14-11bf82e62249 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.338150 Aug 24 05:46:25.964530 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 126/250] 10.222.0.15 () {62 vars in 1200 bytes} [Wed Aug 24 05:46:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 341 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 05:46:26.039926 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-44ac18f1-ea26-4dfe-90fd-bf80503eb564 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:26.040544 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-44ac18f1-ea26-4dfe-90fd-bf80503eb564 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:26.047596 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44ac18f1-ea26-4dfe-90fd-bf80503eb564 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.048092 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44ac18f1-ea26-4dfe-90fd-bf80503eb564 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.049647 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44ac18f1-ea26-4dfe-90fd-bf80503eb564 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.050378 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44ac18f1-ea26-4dfe-90fd-bf80503eb564 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.050838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44ac18f1-ea26-4dfe-90fd-bf80503eb564 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.051265 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-44ac18f1-ea26-4dfe-90fd-bf80503eb564 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.087109 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-44ac18f1-ea26-4dfe-90fd-bf80503eb564 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:46:26.357398 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fc3b8031-692b-4941-ba25-68fc6f3942ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:26.362801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-fc3b8031-692b-4941-ba25-68fc6f3942ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:26.538578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc3b8031-692b-4941-ba25-68fc6f3942ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.539319 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc3b8031-692b-4941-ba25-68fc6f3942ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.540042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc3b8031-692b-4941-ba25-68fc6f3942ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.540834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc3b8031-692b-4941-ba25-68fc6f3942ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.547888 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc3b8031-692b-4941-ba25-68fc6f3942ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.547888 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fc3b8031-692b-4941-ba25-68fc6f3942ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.567057 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-44ac18f1-ea26-4dfe-90fd-bf80503eb564 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 204 len: 0 microversion: 2.1 time: 0.531540 Aug 24 05:46:26.574774 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 125/251] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:46:26 2022] DELETE /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:46:26.583300 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3fc1f1bf-7aec-4fb6-beed-5c245c872c43 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:26.584344 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3fc1f1bf-7aec-4fb6-beed-5c245c872c43 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:26.590742 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fc1f1bf-7aec-4fb6-beed-5c245c872c43 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.591224 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fc1f1bf-7aec-4fb6-beed-5c245c872c43 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.591893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fc1f1bf-7aec-4fb6-beed-5c245c872c43 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.592631 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fc1f1bf-7aec-4fb6-beed-5c245c872c43 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.593088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fc1f1bf-7aec-4fb6-beed-5c245c872c43 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.593517 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fc1f1bf-7aec-4fb6-beed-5c245c872c43 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.803848 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-fc3b8031-692b-4941-ba25-68fc6f3942ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:26.820792 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-fc3b8031-692b-4941-ba25-68fc6f3942ca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.467930 Aug 24 05:46:26.822706 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 127/252] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:26 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:26.880047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3fc1f1bf-7aec-4fb6-beed-5c245c872c43 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:26.888832 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3fc1f1bf-7aec-4fb6-beed-5c245c872c43 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1505 microversion: 2.1 time: 0.312514 Aug 24 05:46:26.889484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 126/253] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:26 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:27.846163 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1bbbe84c-67d0-44c1-8dcd-9e6e6bd052d1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:27.846793 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1bbbe84c-67d0-44c1-8dcd-9e6e6bd052d1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:27.870208 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1bbbe84c-67d0-44c1-8dcd-9e6e6bd052d1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:27.870208 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1bbbe84c-67d0-44c1-8dcd-9e6e6bd052d1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:27.870208 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1bbbe84c-67d0-44c1-8dcd-9e6e6bd052d1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:27.870208 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1bbbe84c-67d0-44c1-8dcd-9e6e6bd052d1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:27.870519 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1bbbe84c-67d0-44c1-8dcd-9e6e6bd052d1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:27.870519 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1bbbe84c-67d0-44c1-8dcd-9e6e6bd052d1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:27.920582 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-cb122160-b071-435a-ab9f-186d3ef5fb6b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:27.927071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-cb122160-b071-435a-ab9f-186d3ef5fb6b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:27.942193 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb122160-b071-435a-ab9f-186d3ef5fb6b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:27.943804 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb122160-b071-435a-ab9f-186d3ef5fb6b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:27.944725 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb122160-b071-435a-ab9f-186d3ef5fb6b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:27.949262 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb122160-b071-435a-ab9f-186d3ef5fb6b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:27.949913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb122160-b071-435a-ab9f-186d3ef5fb6b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:27.953316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb122160-b071-435a-ab9f-186d3ef5fb6b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:28.364158 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1bbbe84c-67d0-44c1-8dcd-9e6e6bd052d1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:28.370284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-cb122160-b071-435a-ab9f-186d3ef5fb6b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:28.372731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1bbbe84c-67d0-44c1-8dcd-9e6e6bd052d1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.532043 Aug 24 05:46:28.380817 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-cb122160-b071-435a-ab9f-186d3ef5fb6b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1505 microversion: 2.1 time: 0.472788 Aug 24 05:46:28.382342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 127/254] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:27 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:28.382580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 128/255] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:27 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:29.403383 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1fbe6d6c-f4c5-4ea3-a81e-f4ced7f71d5c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:29.404227 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1fbe6d6c-f4c5-4ea3-a81e-f4ced7f71d5c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:29.415208 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1fbe6d6c-f4c5-4ea3-a81e-f4ced7f71d5c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:29.417235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1fbe6d6c-f4c5-4ea3-a81e-f4ced7f71d5c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:29.417827 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-071a070c-0017-4ea8-8493-5bc2d2176c5a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:29.422620 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-071a070c-0017-4ea8-8493-5bc2d2176c5a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:29.423490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1fbe6d6c-f4c5-4ea3-a81e-f4ced7f71d5c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:29.426155 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1fbe6d6c-f4c5-4ea3-a81e-f4ced7f71d5c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:29.426686 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1fbe6d6c-f4c5-4ea3-a81e-f4ced7f71d5c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:29.427658 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1fbe6d6c-f4c5-4ea3-a81e-f4ced7f71d5c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:29.439000 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-071a070c-0017-4ea8-8493-5bc2d2176c5a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:29.439773 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-071a070c-0017-4ea8-8493-5bc2d2176c5a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:29.443999 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-071a070c-0017-4ea8-8493-5bc2d2176c5a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:29.445720 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-071a070c-0017-4ea8-8493-5bc2d2176c5a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:29.446230 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-071a070c-0017-4ea8-8493-5bc2d2176c5a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:29.446683 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-071a070c-0017-4ea8-8493-5bc2d2176c5a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:29.804121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1fbe6d6c-f4c5-4ea3-a81e-f4ced7f71d5c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:29.814129 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1fbe6d6c-f4c5-4ea3-a81e-f4ced7f71d5c tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1505 microversion: 2.1 time: 0.414556 Aug 24 05:46:29.815635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 129/256] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:29 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:29.822361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-995931561", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c683523e-e908-47ba-b69c-3344c60dbfc8"}], "security_groups": [{"name": "tempest-securitygroup--581747913"}], "key_name": "tempest-keypair-1482383248", "user_data": "}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:29.822578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-071a070c-0017-4ea8-8493-5bc2d2176c5a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:29.832835 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-071a070c-0017-4ea8-8493-5bc2d2176c5a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.433176 Aug 24 05:46:29.845146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 128/257] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:29 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:30.009759 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.network.neutron [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] validate_networks() for [('c683523e-e908-47ba-b69c-3344c60dbfc8', None, None, None, None, None)] {{(pid=127756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:46:30.562071 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Flavor limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:46:30.568706 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Image limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:46:30.568706 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Flavor pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:46:30.568706 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Image pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:46:30.568706 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:46:30.575149 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:30.575629 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:30.576058 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:30.576845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:30.577296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:30.577717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:30.597644 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Getting quotas for project 56fbd96812654d16bbcf3522574a67eb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:30.604128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Getting quotas for user c7ef3bf8dfd342f5a2fef02bf597af90 and project 56fbd96812654d16bbcf3522574a67eb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:30.632153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Going to run 1 instances... {{(pid=127756) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:46:30.635403 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:46:30.790603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-77ded50e-8ea1-4d0d-a778-48926c4d3f4d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.973551 Aug 24 05:46:30.793339 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 130/258] 10.222.0.15 () {62 vars in 1188 bytes} [Wed Aug 24 05:46:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 05:46:30.835292 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-050844fa-2264-48f3-8352-d57c9d8ff868 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:30.838757 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-050844fa-2264-48f3-8352-d57c9d8ff868 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:30.853502 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-95cbc154-6bf1-4cab-8cb6-b69c5ba64b70 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:30.856733 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-95cbc154-6bf1-4cab-8cb6-b69c5ba64b70 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:30.912941 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95cbc154-6bf1-4cab-8cb6-b69c5ba64b70 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:30.914209 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95cbc154-6bf1-4cab-8cb6-b69c5ba64b70 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:30.920731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95cbc154-6bf1-4cab-8cb6-b69c5ba64b70 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:30.923825 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95cbc154-6bf1-4cab-8cb6-b69c5ba64b70 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:30.924998 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95cbc154-6bf1-4cab-8cb6-b69c5ba64b70 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:30.931772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95cbc154-6bf1-4cab-8cb6-b69c5ba64b70 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:30.968864 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-050844fa-2264-48f3-8352-d57c9d8ff868 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:30.987349 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-050844fa-2264-48f3-8352-d57c9d8ff868 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:30.991619 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-050844fa-2264-48f3-8352-d57c9d8ff868 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:30.993221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-050844fa-2264-48f3-8352-d57c9d8ff868 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1281 microversion: 2.20 time: 0.186928 Aug 24 05:46:31.003960 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 129/259] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:30 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:31.004452 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-69b10d6e-2b24-41e4-94d3-b0e1216bb2b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:31.005562 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-69b10d6e-2b24-41e4-94d3-b0e1216bb2b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:31.016172 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69b10d6e-2b24-41e4-94d3-b0e1216bb2b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:31.016817 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69b10d6e-2b24-41e4-94d3-b0e1216bb2b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:31.017358 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69b10d6e-2b24-41e4-94d3-b0e1216bb2b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:31.020001 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69b10d6e-2b24-41e4-94d3-b0e1216bb2b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:31.020554 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69b10d6e-2b24-41e4-94d3-b0e1216bb2b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:31.021263 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69b10d6e-2b24-41e4-94d3-b0e1216bb2b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:31.321523 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-95cbc154-6bf1-4cab-8cb6-b69c5ba64b70 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:31.326162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:31.337712 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-95cbc154-6bf1-4cab-8cb6-b69c5ba64b70 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1505 microversion: 2.1 time: 0.496354 Aug 24 05:46:31.353359 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 131/260] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:30 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:31.358530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-69b10d6e-2b24-41e4-94d3-b0e1216bb2b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:31.369996 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-69b10d6e-2b24-41e4-94d3-b0e1216bb2b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.373265 Aug 24 05:46:31.371087 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 130/261] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:30 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:31.813598 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-0ba5c75b-08f9-4ca5-95e0-c2f22f5aa3d0 req-098f70bd-23d3-4b0e-9d1f-2485a4fa425e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c853b4f-d418-48a3-9ee7-56fda639a2a8", "name": "network-vif-deleted", "tag": "a2cde1a2-7475-4c77-a36a-ca4198244f5d"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:31.825623 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-0ba5c75b-08f9-4ca5-95e0-c2f22f5aa3d0 req-098f70bd-23d3-4b0e-9d1f-2485a4fa425e service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:31.826095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-0ba5c75b-08f9-4ca5-95e0-c2f22f5aa3d0 req-098f70bd-23d3-4b0e-9d1f-2485a4fa425e service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:31.826523 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-0ba5c75b-08f9-4ca5-95e0-c2f22f5aa3d0 req-098f70bd-23d3-4b0e-9d1f-2485a4fa425e service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:31.839978 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-0ba5c75b-08f9-4ca5-95e0-c2f22f5aa3d0 req-098f70bd-23d3-4b0e-9d1f-2485a4fa425e service nova] Creating event network-vif-deleted:a2cde1a2-7475-4c77-a36a-ca4198244f5d for instance 9c853b4f-d418-48a3-9ee7-56fda639a2a8 on hv-cinder-85426 Aug 24 05:46:31.846482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-0ba5c75b-08f9-4ca5-95e0-c2f22f5aa3d0 req-098f70bd-23d3-4b0e-9d1f-2485a4fa425e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039350 Aug 24 05:46:31.847248 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 132/262] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:32.022378 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-64c596e9-051f-490e-84f0-6711ae2bcef2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:32.023444 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-64c596e9-051f-490e-84f0-6711ae2bcef2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:32.125584 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-64c596e9-051f-490e-84f0-6711ae2bcef2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:32.147598 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-64c596e9-051f-490e-84f0-6711ae2bcef2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:32.154364 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-64c596e9-051f-490e-84f0-6711ae2bcef2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:32.154364 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-64c596e9-051f-490e-84f0-6711ae2bcef2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1281 microversion: 2.20 time: 0.136900 Aug 24 05:46:32.161014 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 131/263] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:32 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1281 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:32.366833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-99985aab-b27c-47f5-a35f-7b8397cd7197 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:32.367452 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-99985aab-b27c-47f5-a35f-7b8397cd7197 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:32.374175 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99985aab-b27c-47f5-a35f-7b8397cd7197 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:32.374661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99985aab-b27c-47f5-a35f-7b8397cd7197 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:32.375088 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99985aab-b27c-47f5-a35f-7b8397cd7197 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.375973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99985aab-b27c-47f5-a35f-7b8397cd7197 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:32.376720 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99985aab-b27c-47f5-a35f-7b8397cd7197 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:32.377202 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99985aab-b27c-47f5-a35f-7b8397cd7197 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.396051 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-47cf449d-733d-4db4-ab50-c38cc1889e84 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:32.397335 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-47cf449d-733d-4db4-ab50-c38cc1889e84 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:32.408839 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47cf449d-733d-4db4-ab50-c38cc1889e84 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:32.410436 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47cf449d-733d-4db4-ab50-c38cc1889e84 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:32.411451 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47cf449d-733d-4db4-ab50-c38cc1889e84 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.412732 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47cf449d-733d-4db4-ab50-c38cc1889e84 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:32.413544 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47cf449d-733d-4db4-ab50-c38cc1889e84 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:32.414030 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47cf449d-733d-4db4-ab50-c38cc1889e84 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.456272 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-99985aab-b27c-47f5-a35f-7b8397cd7197 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:32.467273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-99985aab-b27c-47f5-a35f-7b8397cd7197 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1463 microversion: 2.1 time: 0.108778 Aug 24 05:46:32.468343 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 133/264] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:32 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1463 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:32.605973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-47cf449d-733d-4db4-ab50-c38cc1889e84 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:32.615165 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-47cf449d-733d-4db4-ab50-c38cc1889e84 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.225377 Aug 24 05:46:32.615757 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 132/265] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:32 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:33.196678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:33.197525 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:33.205794 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.206198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.206654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.207397 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.207855 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.208282 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.276110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:33.289240 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:33.291934 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:33.294058 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1e382340-8ec0-4e4e-b54a-053fa80358dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1285 microversion: 2.20 time: 0.101802 Aug 24 05:46:33.295071 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 134/266] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:33 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:33.497360 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:33.498061 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:33.505034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.505527 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.505968 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.506676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.507314 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.507912 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.542997 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.543489 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.543932 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.544419 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lazy-loading 'fault' on Instance uuid 9c853b4f-d418-48a3-9ee7-56fda639a2a8 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:46:33.596913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:33.605345 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-98138965-caad-4524-81c0-1143d58b160a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1304 microversion: 2.1 time: 0.111926 Aug 24 05:46:33.605964 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 133/267] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:33 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:33.637541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ae832a0b-af69-43c4-83b8-0a75d8d82e96 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:33.638152 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ae832a0b-af69-43c4-83b8-0a75d8d82e96 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:33.644883 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae832a0b-af69-43c4-83b8-0a75d8d82e96 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.645378 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae832a0b-af69-43c4-83b8-0a75d8d82e96 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.645820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae832a0b-af69-43c4-83b8-0a75d8d82e96 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.646513 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae832a0b-af69-43c4-83b8-0a75d8d82e96 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.646995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae832a0b-af69-43c4-83b8-0a75d8d82e96 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.647425 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae832a0b-af69-43c4-83b8-0a75d8d82e96 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.804657 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ae832a0b-af69-43c4-83b8-0a75d8d82e96 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:33.817958 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ae832a0b-af69-43c4-83b8-0a75d8d82e96 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.183967 Aug 24 05:46:33.818996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 135/268] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:33 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:34.321155 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:34.321669 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:34.327953 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.328460 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.328898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.329586 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.331187 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.331959 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.338171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:34.402997 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:34.421368 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:34.424813 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:34.426995 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-37a67b84-35fe-4037-b593-2a0fac8f0913 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1285 microversion: 2.20 time: 0.109518 Aug 24 05:46:34.428016 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 134/269] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:34 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:34.628667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:34.629294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:34.636016 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.636537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.636981 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.637847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.638214 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.638642 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.672735 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.673227 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.673941 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.674791 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lazy-loading 'fault' on Instance uuid 9c853b4f-d418-48a3-9ee7-56fda639a2a8 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:46:34.717304 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:34.725667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e0da04b7-4025-4255-943e-44e5649fd3c5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1304 microversion: 2.1 time: 0.102205 Aug 24 05:46:34.726242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 136/270] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:34 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:34.842778 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2c7e582b-9030-4ec8-b011-230e222c30f0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:34.843409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2c7e582b-9030-4ec8-b011-230e222c30f0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:34.850680 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7e582b-9030-4ec8-b011-230e222c30f0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.851255 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7e582b-9030-4ec8-b011-230e222c30f0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.851719 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7e582b-9030-4ec8-b011-230e222c30f0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.856091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7e582b-9030-4ec8-b011-230e222c30f0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.856091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7e582b-9030-4ec8-b011-230e222c30f0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.856091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7e582b-9030-4ec8-b011-230e222c30f0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.010407 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2c7e582b-9030-4ec8-b011-230e222c30f0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:35.019027 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2c7e582b-9030-4ec8-b011-230e222c30f0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.179971 Aug 24 05:46:35.019621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 135/271] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:34 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:35.451314 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:35.451932 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:35.459038 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:35.459536 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:35.460119 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.460865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:35.461324 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:35.461757 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.533774 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:35.543205 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:35.544776 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:35.545921 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7ec9ee86-2a41-4971-83ce-df4cc2a8b8ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1285 microversion: 2.20 time: 0.098760 Aug 24 05:46:35.546531 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 137/272] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:35 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:35.748273 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:35.748918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:35.755608 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:35.756099 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:35.756578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.757279 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:35.757746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:35.758171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.792889 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:35.793366 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:35.793805 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.794249 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lazy-loading 'fault' on Instance uuid 9c853b4f-d418-48a3-9ee7-56fda639a2a8 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:46:35.836629 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:35.846480 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-dac5f3c4-abd6-4e8a-8ff0-9cbeb780c592 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1304 microversion: 2.1 time: 0.102220 Aug 24 05:46:35.848531 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 136/273] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:35 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:36.042123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b009bd74-5054-4947-b01b-8d57f295454d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:36.042744 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b009bd74-5054-4947-b01b-8d57f295454d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:36.050191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b009bd74-5054-4947-b01b-8d57f295454d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.050713 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b009bd74-5054-4947-b01b-8d57f295454d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.051158 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b009bd74-5054-4947-b01b-8d57f295454d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.052088 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b009bd74-5054-4947-b01b-8d57f295454d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.052589 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b009bd74-5054-4947-b01b-8d57f295454d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.053042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b009bd74-5054-4947-b01b-8d57f295454d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.210130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b009bd74-5054-4947-b01b-8d57f295454d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:36.218086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b009bd74-5054-4947-b01b-8d57f295454d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1522 microversion: 2.1 time: 0.180285 Aug 24 05:46:36.218662 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 138/274] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:36 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:36.570673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:36.571281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:36.581262 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.581738 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.582171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.582881 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.583342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.583767 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.685445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:36.700248 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:36.704120 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:36.707455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d665640e-4237-49cc-9106-ecd43ab3fed8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1285 microversion: 2.20 time: 0.140944 Aug 24 05:46:36.710934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 137/275] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:36 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:36.869875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:36.871027 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:36.883956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.884876 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.885654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.886901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.887894 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.888507 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.937376 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.937768 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.938197 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.938649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lazy-loading 'fault' on Instance uuid 9c853b4f-d418-48a3-9ee7-56fda639a2a8 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:46:36.983834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:36.993088 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e58d2cfe-2ba6-41cf-9814-1a8b37d694fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1304 microversion: 2.1 time: 0.129494 Aug 24 05:46:36.993675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 139/276] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:36 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:37.239006 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-74d4365d-2f01-4c27-adb2-824a7eb2889e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:37.239900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-74d4365d-2f01-4c27-adb2-824a7eb2889e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:37.245931 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74d4365d-2f01-4c27-adb2-824a7eb2889e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.246413 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74d4365d-2f01-4c27-adb2-824a7eb2889e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.246850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74d4365d-2f01-4c27-adb2-824a7eb2889e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.252537 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74d4365d-2f01-4c27-adb2-824a7eb2889e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.252537 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74d4365d-2f01-4c27-adb2-824a7eb2889e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.252537 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74d4365d-2f01-4c27-adb2-824a7eb2889e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.391549 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-74d4365d-2f01-4c27-adb2-824a7eb2889e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:37.401417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-74d4365d-2f01-4c27-adb2-824a7eb2889e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1502 microversion: 2.1 time: 0.167152 Aug 24 05:46:37.402108 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 138/277] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:37 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:37.423538 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-902acd2d-4118-4e11-a6cd-a61b8e9c7b04 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:37.425355 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-902acd2d-4118-4e11-a6cd-a61b8e9c7b04 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:37.432720 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-902acd2d-4118-4e11-a6cd-a61b8e9c7b04 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.433223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-902acd2d-4118-4e11-a6cd-a61b8e9c7b04 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.433808 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-902acd2d-4118-4e11-a6cd-a61b8e9c7b04 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.434518 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-902acd2d-4118-4e11-a6cd-a61b8e9c7b04 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.434981 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-902acd2d-4118-4e11-a6cd-a61b8e9c7b04 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.435416 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-902acd2d-4118-4e11-a6cd-a61b8e9c7b04 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.608615 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-902acd2d-4118-4e11-a6cd-a61b8e9c7b04 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:37.619914 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-902acd2d-4118-4e11-a6cd-a61b8e9c7b04 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1516 microversion: 2.1 time: 0.200195 Aug 24 05:46:37.620842 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 140/278] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:37 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:37.738848 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:37.739738 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:37.750912 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.752031 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.752883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.754204 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.755421 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.756062 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.896472 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:37.906140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:37.908637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:37.909807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-24e0c819-5f69-493b-94be-1c3cbf01c6c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1277 microversion: 2.20 time: 0.177504 Aug 24 05:46:37.910884 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 139/279] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:37 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:38.015396 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:38.016015 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:38.023367 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.023860 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.024298 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.025034 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.025492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.025930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.061523 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.061983 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.062490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.062940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lazy-loading 'fault' on Instance uuid 9c853b4f-d418-48a3-9ee7-56fda639a2a8 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:46:38.117002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:38.117002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2e09316a-2b60-4407-bdf0-7569b5009881 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 200 len: 1304 microversion: 2.1 time: 0.103185 Aug 24 05:46:38.117002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 141/280] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:38 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:38.953790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:38.953790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:38.956059 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.956489 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.956927 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.957651 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.958243 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.958668 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:39.024202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:39.039216 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:39.040772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:39.042176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4fc6edfb-b34f-496f-838e-a0bb3010c516 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1333 microversion: 2.20 time: 0.098634 Aug 24 05:46:39.042738 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 140/281] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:38 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:39.137012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:39.137697 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: 9c853b4f-d418-48a3-9ee7-56fda639a2a8] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:39.143436 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:39.148846 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:39.149389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:39.149985 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:39.151070 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:39.151689 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:39.152177 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:39.168335 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] HTTP exception thrown: Instance 9c853b4f-d418-48a3-9ee7-56fda639a2a8 could not be found. Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Request method failure captured: Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 HTTP/1.1 Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbsULLZAwvyVdDhlCzb2-5roKKB1QhJ7vL3-kWE6KbNh3UZp1ZD8LT8-j0ituw5EZGK29HVp_f2oI_Ch9MwtUpkD6vIQjo4O4ueWkwyhH0r0g_4zLuLUm8Mw_dxuu4lxsYPy_jHK96T-NeKfEx0Iu9SNFQDi_UC5Tr0-MCMnH36IxoE Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 43149d6590a6468b83faa5f1cd7c6b59 Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-VolumesActionsTest-400159807 Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:46:39.170042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_43149d6590a6468b83faa5f1cd7c6b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/43149d6590a6468b83faa5f1cd7c6b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/43149d6590a6468b83faa5f1cd7c6b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/43149d6590a6468b83faa5f1cd7c6b59"}]}] Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-VolumesActionsTest-400159807 Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 43149d6590a6468b83faa5f1cd7c6b59 Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-VolumesActionsTest-400159807 Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-VolumesActionsTest-400159807-project Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 1c85840c4d104b04b6ed577cce2ca2ff Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-VolumesActionsTest-400159807-project Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 9c853b4f-d418-48a3-9ee7-56fda639a2a8 could not be found. Aug 24 05:46:39.171659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '9c853b4f-d418-48a3-9ee7-56fda639a2a8'} Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c853b4f-d418-48a3-9ee7-56fda639a2a8 could not be found. Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:46:39.172650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c853b4f-d418-48a3-9ee7-56fda639a2a8 could not be found. Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c853b4f-d418-48a3-9ee7-56fda639a2a8 could not be found. Aug 24 05:46:39.174474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:46:39.175817 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Returning 404 to user: Instance 9c853b4f-d418-48a3-9ee7-56fda639a2a8 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:46:39.175817 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-98d7c87d-4f9c-4253-9992-4f524925bb3d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8" status: 404 len: 111 microversion: 2.1 time: 0.038278 Aug 24 05:46:39.175817 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 142/282] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:39 2022] GET /compute/v2.1/servers/9c853b4f-d418-48a3-9ee7-56fda639a2a8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:46:39.435952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-657450204", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "networks": [{"uuid": "caefaf7b-2ef5-4b4b-91a4-afe0dd0fe07f"}]}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:39.507652 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] validate_networks() for [('caefaf7b-2ef5-4b4b-91a4-afe0dd0fe07f', None, None, None, None, None)] {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:46:39.913755 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:46:39.914231 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:46:39.914715 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:46:39.915130 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:46:39.915645 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:46:39.934940 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:39.936343 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:39.942883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:39.942883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:39.942883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:39.942883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:39.962198 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Getting quotas for project 43149d6590a6468b83faa5f1cd7c6b59. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:39.967347 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Getting quotas for user 1c85840c4d104b04b6ed577cce2ca2ff and project 43149d6590a6468b83faa5f1cd7c6b59. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:39.993582 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:46:39.996935 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:46:40.067785 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:40.068424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:40.085113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:40.088979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:40.089429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:40.090523 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:40.092752 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:40.094188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:40.167884 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:40.178249 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:40.181333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:40.181558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f995c0c1-984f-4e05-9fe9-15cf6d2020f7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1339 microversion: 2.20 time: 0.120015 Aug 24 05:46:40.188797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 143/283] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:40 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1339 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:40.192486 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9129ced8-db88-495d-aef9-c861d124246f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761272 Aug 24 05:46:40.193853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 141/284] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:46:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:46:40.205302 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-49047098-e377-4c90-adfd-299bd378f0d1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:40.205960 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-49047098-e377-4c90-adfd-299bd378f0d1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:40.265040 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-49047098-e377-4c90-adfd-299bd378f0d1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:40.276929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-49047098-e377-4c90-adfd-299bd378f0d1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1213 microversion: 2.1 time: 0.075637 Aug 24 05:46:40.280319 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 144/285] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:40 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:41.214536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:41.216122 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:41.223950 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:41.224919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:41.224919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:41.225690 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:41.226250 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:41.226678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:41.300846 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7a57bb0f-0935-44d9-9968-8bdc93320193 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:41.302137 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7a57bb0f-0935-44d9-9968-8bdc93320193 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:41.304382 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:41.451593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7a57bb0f-0935-44d9-9968-8bdc93320193 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:41.473952 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7a57bb0f-0935-44d9-9968-8bdc93320193 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1213 microversion: 2.1 time: 0.176904 Aug 24 05:46:41.475806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 145/286] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:41 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1213 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:41.499259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:41.515895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:41.518368 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:41.522239 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f9476568-f9cd-4fce-aa5b-9652019a6f9d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.312060 Aug 24 05:46:41.532871 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 142/287] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:41 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:41.714329 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-4a5c0c14-ed82-40ba-838a-28783942316c req-541091db-f371-4aed-ab34-6c5ce73be0dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27d92fba-9c39-4b5f-971f-83d972055316", "tag": "14ce7c9b-e214-4a48-bcb6-c730bc8b2303"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:41.728597 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-4a5c0c14-ed82-40ba-838a-28783942316c req-541091db-f371-4aed-ab34-6c5ce73be0dc service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:41.735312 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-4a5c0c14-ed82-40ba-838a-28783942316c req-541091db-f371-4aed-ab34-6c5ce73be0dc service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:41.735312 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-4a5c0c14-ed82-40ba-838a-28783942316c req-541091db-f371-4aed-ab34-6c5ce73be0dc service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:41.742977 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-4a5c0c14-ed82-40ba-838a-28783942316c req-541091db-f371-4aed-ab34-6c5ce73be0dc service nova] Creating event network-changed:14ce7c9b-e214-4a48-bcb6-c730bc8b2303 for instance 27d92fba-9c39-4b5f-971f-83d972055316 on hv-cinder-85426 Aug 24 05:46:41.748255 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-4a5c0c14-ed82-40ba-838a-28783942316c req-541091db-f371-4aed-ab34-6c5ce73be0dc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043451 Aug 24 05:46:41.749268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 146/288] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:42.499194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9841ec1f-59e6-4ba5-8dea-79ea0e764280 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:42.499967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9841ec1f-59e6-4ba5-8dea-79ea0e764280 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:42.502552 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:42.508595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9841ec1f-59e6-4ba5-8dea-79ea0e764280 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:42.509492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9841ec1f-59e6-4ba5-8dea-79ea0e764280 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:42.510221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9841ec1f-59e6-4ba5-8dea-79ea0e764280 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:42.515267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9841ec1f-59e6-4ba5-8dea-79ea0e764280 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:42.515763 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9841ec1f-59e6-4ba5-8dea-79ea0e764280 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:42.516481 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9841ec1f-59e6-4ba5-8dea-79ea0e764280 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:42.548563 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:42.550613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:42.558365 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:42.559150 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:42.559712 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:42.560714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:42.561326 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:42.562019 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:42.628959 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9841ec1f-59e6-4ba5-8dea-79ea0e764280 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:42.638343 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9841ec1f-59e6-4ba5-8dea-79ea0e764280 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1265 microversion: 2.1 time: 0.143069 Aug 24 05:46:42.639038 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 143/289] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:42 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:42.802477 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:42.824915 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:42.827003 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:42.829517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-88a16d57-243d-4d6d-b57c-4146055bb51e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.285689 Aug 24 05:46:42.830433 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 147/290] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:42 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:43.317149 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7b55dff1-2493-4c3b-aa4f-44abd7bf4871 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:43.320301 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7b55dff1-2493-4c3b-aa4f-44abd7bf4871 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:43.330411 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b55dff1-2493-4c3b-aa4f-44abd7bf4871 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.331243 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b55dff1-2493-4c3b-aa4f-44abd7bf4871 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.331900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b55dff1-2493-4c3b-aa4f-44abd7bf4871 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:43.333088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b55dff1-2493-4c3b-aa4f-44abd7bf4871 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.343432 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b55dff1-2493-4c3b-aa4f-44abd7bf4871 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.343432 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b55dff1-2493-4c3b-aa4f-44abd7bf4871 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:43.359896 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-7b55dff1-2493-4c3b-aa4f-44abd7bf4871 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lazy-loading 'flavor' on Instance uuid 876be02b-9b39-4f01-9650-28904167d60f {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:46:43.673085 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b8373b61-842a-42af-a6a3-84d67da6e5c1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:43.675147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b8373b61-842a-42af-a6a3-84d67da6e5c1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:43.689748 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8373b61-842a-42af-a6a3-84d67da6e5c1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.690901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8373b61-842a-42af-a6a3-84d67da6e5c1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.694284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8373b61-842a-42af-a6a3-84d67da6e5c1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:43.694284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8373b61-842a-42af-a6a3-84d67da6e5c1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.694284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8373b61-842a-42af-a6a3-84d67da6e5c1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.694770 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b8373b61-842a-42af-a6a3-84d67da6e5c1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:43.805848 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b8373b61-842a-42af-a6a3-84d67da6e5c1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:43.821076 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b8373b61-842a-42af-a6a3-84d67da6e5c1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1271 microversion: 2.1 time: 0.156103 Aug 24 05:46:43.836260 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 148/291] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:43 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:43.864029 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:43.864930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:43.881106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.881106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.881106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:43.890211 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.891213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.892588 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:43.933421 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7b55dff1-2493-4c3b-aa4f-44abd7bf4871 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "POST /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f/action" status: 200 len: 32 microversion: 2.1 time: 0.621390 Aug 24 05:46:43.934285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 144/292] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:46:43 2022] POST /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f/action => generated 32 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:46:43.945835 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b89363ec-5543-48a1-a938-2cc8a50da544 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:43.946645 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b89363ec-5543-48a1-a938-2cc8a50da544 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:43.954309 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b89363ec-5543-48a1-a938-2cc8a50da544 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.955705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b89363ec-5543-48a1-a938-2cc8a50da544 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.956224 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b89363ec-5543-48a1-a938-2cc8a50da544 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:43.957068 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b89363ec-5543-48a1-a938-2cc8a50da544 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.957615 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b89363ec-5543-48a1-a938-2cc8a50da544 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.958115 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b89363ec-5543-48a1-a938-2cc8a50da544 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:44.162137 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:44.180611 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:44.196156 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:44.198890 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-54a48162-c176-4b17-a0a8-3385a8f952fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.342910 Aug 24 05:46:44.204378 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 149/293] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:43 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:44.346475 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b89363ec-5543-48a1-a938-2cc8a50da544 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:44.366084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b89363ec-5543-48a1-a938-2cc8a50da544 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.424389 Aug 24 05:46:44.367294 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 145/294] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:43 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:44.846357 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1c142027-5661-4035-a8e8-87f13b656fc8 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:44.846978 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1c142027-5661-4035-a8e8-87f13b656fc8 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:44.854005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c142027-5661-4035-a8e8-87f13b656fc8 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:44.854506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c142027-5661-4035-a8e8-87f13b656fc8 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:44.855283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c142027-5661-4035-a8e8-87f13b656fc8 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:44.856258 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c142027-5661-4035-a8e8-87f13b656fc8 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:44.857021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c142027-5661-4035-a8e8-87f13b656fc8 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:44.857165 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c142027-5661-4035-a8e8-87f13b656fc8 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.227110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:45.228096 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:45.249401 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:45.249401 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:45.249401 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.254597 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:45.258404 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:45.259181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.346416 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1c142027-5661-4035-a8e8-87f13b656fc8 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:45.355917 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1c142027-5661-4035-a8e8-87f13b656fc8 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.515474 Aug 24 05:46:45.356793 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 150/295] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:44 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:45.399840 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7382b089-84a3-432b-9b1e-1e28ca4291fd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:45.402373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7382b089-84a3-432b-9b1e-1e28ca4291fd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:45.409458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7382b089-84a3-432b-9b1e-1e28ca4291fd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:45.409951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7382b089-84a3-432b-9b1e-1e28ca4291fd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:45.410583 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7382b089-84a3-432b-9b1e-1e28ca4291fd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.411300 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7382b089-84a3-432b-9b1e-1e28ca4291fd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:45.411759 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7382b089-84a3-432b-9b1e-1e28ca4291fd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:45.412181 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7382b089-84a3-432b-9b1e-1e28ca4291fd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.431358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:45.471250 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:45.480375 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:45.481951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:45.483071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d5b121e1-da9b-454d-ba63-61268ee34aaf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.261690 Aug 24 05:46:45.483625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 146/296] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:45 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:45.576240 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7382b089-84a3-432b-9b1e-1e28ca4291fd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:45.590748 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7382b089-84a3-432b-9b1e-1e28ca4291fd tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.194631 Aug 24 05:46:45.590748 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 151/297] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:45 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:46.391579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a32ceaec-fbf7-4b8a-9072-d044b57e69a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:46.395678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a32ceaec-fbf7-4b8a-9072-d044b57e69a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:46.403580 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a32ceaec-fbf7-4b8a-9072-d044b57e69a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.404305 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a32ceaec-fbf7-4b8a-9072-d044b57e69a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.404990 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a32ceaec-fbf7-4b8a-9072-d044b57e69a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.405867 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a32ceaec-fbf7-4b8a-9072-d044b57e69a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.406721 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a32ceaec-fbf7-4b8a-9072-d044b57e69a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.407252 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a32ceaec-fbf7-4b8a-9072-d044b57e69a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.525920 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:46.525920 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:46.547632 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.550364 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.551724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.553825 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.555017 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.556215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.629302 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a32ceaec-fbf7-4b8a-9072-d044b57e69a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:46.644560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a32ceaec-fbf7-4b8a-9072-d044b57e69a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.254478 Aug 24 05:46:46.646171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 147/298] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:46 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:46.655188 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6748e519-5aeb-4d4d-8694-ad6d0ee922aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:46.656006 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6748e519-5aeb-4d4d-8694-ad6d0ee922aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:46.666641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6748e519-5aeb-4d4d-8694-ad6d0ee922aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.666641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6748e519-5aeb-4d4d-8694-ad6d0ee922aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.666641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6748e519-5aeb-4d4d-8694-ad6d0ee922aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.666641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6748e519-5aeb-4d4d-8694-ad6d0ee922aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.667363 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6748e519-5aeb-4d4d-8694-ad6d0ee922aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.667363 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6748e519-5aeb-4d4d-8694-ad6d0ee922aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.986161 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:46.987489 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6748e519-5aeb-4d4d-8694-ad6d0ee922aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:46.998784 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6748e519-5aeb-4d4d-8694-ad6d0ee922aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.351409 Aug 24 05:46:47.013229 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:47.016235 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 148/299] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:46 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:47.016534 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:47.018390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d8ec768e-c9ae-4791-a37b-fd846d43b510 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.515468 Aug 24 05:46:47.019628 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 152/300] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:46 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:47.666710 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a09ace2b-1b91-4500-b5c3-1b9ea3fbb78d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:47.667879 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a09ace2b-1b91-4500-b5c3-1b9ea3fbb78d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:47.678226 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a09ace2b-1b91-4500-b5c3-1b9ea3fbb78d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:47.678715 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a09ace2b-1b91-4500-b5c3-1b9ea3fbb78d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:47.679721 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a09ace2b-1b91-4500-b5c3-1b9ea3fbb78d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:47.681053 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a09ace2b-1b91-4500-b5c3-1b9ea3fbb78d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:47.682109 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a09ace2b-1b91-4500-b5c3-1b9ea3fbb78d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:47.683211 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a09ace2b-1b91-4500-b5c3-1b9ea3fbb78d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:47.691433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:47.892946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a09ace2b-1b91-4500-b5c3-1b9ea3fbb78d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:47.907048 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a09ace2b-1b91-4500-b5c3-1b9ea3fbb78d tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.244875 Aug 24 05:46:47.922445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 149/301] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:47 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:47.931322 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-bef5bd30-2984-4fe6-9f57-0e5ec9ef386d req-6e84229f-2542-4483-b26e-3ba615c8bb22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d157837c-4de5-4853-91fd-5b8436d96436", "tag": "668e6922-ecd5-406a-b4cb-2ba3e6302727"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:47.946611 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-bef5bd30-2984-4fe6-9f57-0e5ec9ef386d req-6e84229f-2542-4483-b26e-3ba615c8bb22 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:47.947461 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-bef5bd30-2984-4fe6-9f57-0e5ec9ef386d req-6e84229f-2542-4483-b26e-3ba615c8bb22 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:47.948102 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-bef5bd30-2984-4fe6-9f57-0e5ec9ef386d req-6e84229f-2542-4483-b26e-3ba615c8bb22 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:47.960784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-bef5bd30-2984-4fe6-9f57-0e5ec9ef386d req-6e84229f-2542-4483-b26e-3ba615c8bb22 service nova] Creating event network-changed:668e6922-ecd5-406a-b4cb-2ba3e6302727 for instance d157837c-4de5-4853-91fd-5b8436d96436 on hv-cinder-85426 Aug 24 05:46:47.965956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-bef5bd30-2984-4fe6-9f57-0e5ec9ef386d req-6e84229f-2542-4483-b26e-3ba615c8bb22 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039680 Aug 24 05:46:47.966870 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 153/302] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:48.020845 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0e0a8dc2-fa42-4113-83c3-f43af3a27140 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:48.022047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0e0a8dc2-fa42-4113-83c3-f43af3a27140 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:48.033177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e0a8dc2-fa42-4113-83c3-f43af3a27140 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.033177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e0a8dc2-fa42-4113-83c3-f43af3a27140 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.033177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e0a8dc2-fa42-4113-83c3-f43af3a27140 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.034185 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e0a8dc2-fa42-4113-83c3-f43af3a27140 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.034728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e0a8dc2-fa42-4113-83c3-f43af3a27140 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.035232 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e0a8dc2-fa42-4113-83c3-f43af3a27140 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.044805 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:48.045793 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:48.053492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.054340 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.055151 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.056262 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.056955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.057556 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.284765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0e0a8dc2-fa42-4113-83c3-f43af3a27140 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:48.295756 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:48.301530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0e0a8dc2-fa42-4113-83c3-f43af3a27140 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.280784 Aug 24 05:46:48.308818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:48.310764 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:48.311644 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 150/303] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:48 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:48.312449 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6fce8f2f-4b5a-4497-9289-d63b8d2df0cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.273556 Aug 24 05:46:48.313011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 154/304] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:48 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:48.930197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e7509612-52b7-4156-9542-a3971610fabd tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:48.930852 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e7509612-52b7-4156-9542-a3971610fabd tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:48.942592 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7509612-52b7-4156-9542-a3971610fabd tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.943246 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7509612-52b7-4156-9542-a3971610fabd tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.943693 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7509612-52b7-4156-9542-a3971610fabd tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.944426 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7509612-52b7-4156-9542-a3971610fabd tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.944902 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7509612-52b7-4156-9542-a3971610fabd tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.945330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7509612-52b7-4156-9542-a3971610fabd tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:49.087769 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e7509612-52b7-4156-9542-a3971610fabd tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:49.098022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e7509612-52b7-4156-9542-a3971610fabd tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.171819 Aug 24 05:46:49.098671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 151/305] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:48 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:49.319101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-dd68a02a-5198-4d25-9743-f0d31b3a1ece tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:49.319850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-dd68a02a-5198-4d25-9743-f0d31b3a1ece tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:49.326732 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd68a02a-5198-4d25-9743-f0d31b3a1ece tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:49.327215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd68a02a-5198-4d25-9743-f0d31b3a1ece tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:49.327647 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd68a02a-5198-4d25-9743-f0d31b3a1ece tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:49.328369 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd68a02a-5198-4d25-9743-f0d31b3a1ece tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:49.329179 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd68a02a-5198-4d25-9743-f0d31b3a1ece tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:49.330539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd68a02a-5198-4d25-9743-f0d31b3a1ece tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:49.337873 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:49.338874 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:49.351150 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:49.356000 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:49.356818 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:49.357954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:49.358687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:49.359332 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:49.564808 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dd68a02a-5198-4d25-9743-f0d31b3a1ece tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:49.569191 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:49.574467 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-dd68a02a-5198-4d25-9743-f0d31b3a1ece tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.259967 Aug 24 05:46:49.575274 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 155/306] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:49 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:49.582775 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:49.585370 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:49.586656 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-259e6f04-2d3b-4dab-a5a3-76f38480eb50 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.254357 Aug 24 05:46:49.594126 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 152/307] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:49 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:50.125847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-943876e6-b454-4b80-b9a9-3bb906bab1f7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:50.127749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-943876e6-b454-4b80-b9a9-3bb906bab1f7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:50.138620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-943876e6-b454-4b80-b9a9-3bb906bab1f7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.139610 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-943876e6-b454-4b80-b9a9-3bb906bab1f7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.142803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-943876e6-b454-4b80-b9a9-3bb906bab1f7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.142803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-943876e6-b454-4b80-b9a9-3bb906bab1f7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.142803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-943876e6-b454-4b80-b9a9-3bb906bab1f7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.143183 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-943876e6-b454-4b80-b9a9-3bb906bab1f7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.342303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-943876e6-b454-4b80-b9a9-3bb906bab1f7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:50.357514 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-943876e6-b454-4b80-b9a9-3bb906bab1f7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.238425 Aug 24 05:46:50.358367 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 156/308] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:50 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:50.599222 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3c4fb2d0-26d4-4ae5-a02e-cf3e7c01dc68 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:50.599898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3c4fb2d0-26d4-4ae5-a02e-cf3e7c01dc68 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:50.601873 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:50.602598 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=10 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:50.608184 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3c4fb2d0-26d4-4ae5-a02e-cf3e7c01dc68 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.608752 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3c4fb2d0-26d4-4ae5-a02e-cf3e7c01dc68 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.609353 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3c4fb2d0-26d4-4ae5-a02e-cf3e7c01dc68 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.610052 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3c4fb2d0-26d4-4ae5-a02e-cf3e7c01dc68 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.611321 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:50.611525 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3c4fb2d0-26d4-4ae5-a02e-cf3e7c01dc68 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.611679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3c4fb2d0-26d4-4ae5-a02e-cf3e7c01dc68 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.611865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:50.618499 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.619260 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.619785 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.620585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.621047 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.621961 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.850868 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3c4fb2d0-26d4-4ae5-a02e-cf3e7c01dc68 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:50.859940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:50.891003 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3c4fb2d0-26d4-4ae5-a02e-cf3e7c01dc68 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.295943 Aug 24 05:46:50.892814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 153/309] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:50 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:50.894024 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:50.897712 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:50.900187 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-93388a23-4786-4fa4-913d-9d22e249c6c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.294336 Aug 24 05:46:50.903394 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 157/310] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:50 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:51.380566 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8663b9e3-b0c6-46f9-9224-75fd8e3c50a7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:51.381192 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8663b9e3-b0c6-46f9-9224-75fd8e3c50a7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:51.388868 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8663b9e3-b0c6-46f9-9224-75fd8e3c50a7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:51.389626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8663b9e3-b0c6-46f9-9224-75fd8e3c50a7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:51.392320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8663b9e3-b0c6-46f9-9224-75fd8e3c50a7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:51.392320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8663b9e3-b0c6-46f9-9224-75fd8e3c50a7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:51.392320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8663b9e3-b0c6-46f9-9224-75fd8e3c50a7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:51.392320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8663b9e3-b0c6-46f9-9224-75fd8e3c50a7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:51.570667 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8663b9e3-b0c6-46f9-9224-75fd8e3c50a7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:51.578901 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8663b9e3-b0c6-46f9-9224-75fd8e3c50a7 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.202758 Aug 24 05:46:51.584441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 154/311] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:51 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:51.920606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-84218dae-5d1d-4abb-80b3-47d84b9d17d6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:51.921428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-84218dae-5d1d-4abb-80b3-47d84b9d17d6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:51.923958 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=14 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:51.930047 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84218dae-5d1d-4abb-80b3-47d84b9d17d6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:51.930803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84218dae-5d1d-4abb-80b3-47d84b9d17d6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:51.931407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84218dae-5d1d-4abb-80b3-47d84b9d17d6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:51.932310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84218dae-5d1d-4abb-80b3-47d84b9d17d6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:51.933008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84218dae-5d1d-4abb-80b3-47d84b9d17d6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:51.933622 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84218dae-5d1d-4abb-80b3-47d84b9d17d6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:51.942646 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:51.946542 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:51.958994 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:51.960350 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:51.961440 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:51.963358 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:51.964614 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:51.965763 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:52.203454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-84218dae-5d1d-4abb-80b3-47d84b9d17d6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:52.213375 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-84218dae-5d1d-4abb-80b3-47d84b9d17d6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.297750 Aug 24 05:46:52.214658 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 158/312] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:51 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:52.220502 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:52.230582 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:52.234676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:52.234676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a823953d-e6ae-41b0-a574-6e4a5493e50c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.303520 Aug 24 05:46:52.234676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 155/313] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:51 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:52.607591 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3497c679-1ab9-4fc2-9567-2333cc26e40b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:52.608615 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3497c679-1ab9-4fc2-9567-2333cc26e40b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:52.628046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3497c679-1ab9-4fc2-9567-2333cc26e40b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:52.629054 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3497c679-1ab9-4fc2-9567-2333cc26e40b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:52.629723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3497c679-1ab9-4fc2-9567-2333cc26e40b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:52.630542 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3497c679-1ab9-4fc2-9567-2333cc26e40b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:52.631007 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3497c679-1ab9-4fc2-9567-2333cc26e40b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:52.631473 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3497c679-1ab9-4fc2-9567-2333cc26e40b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:52.825674 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3497c679-1ab9-4fc2-9567-2333cc26e40b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:52.840908 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3497c679-1ab9-4fc2-9567-2333cc26e40b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.239715 Aug 24 05:46:52.843428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 159/314] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:52 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:53.238445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1f233676-2ac3-4b52-b6c3-01926da0635b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:53.239082 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1f233676-2ac3-4b52-b6c3-01926da0635b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:53.245796 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f233676-2ac3-4b52-b6c3-01926da0635b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.246297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f233676-2ac3-4b52-b6c3-01926da0635b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.246742 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f233676-2ac3-4b52-b6c3-01926da0635b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:53.247461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f233676-2ac3-4b52-b6c3-01926da0635b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.247923 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f233676-2ac3-4b52-b6c3-01926da0635b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.248362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f233676-2ac3-4b52-b6c3-01926da0635b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:53.259619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:53.260471 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:53.267858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.268476 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.268820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:53.269526 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.269975 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.270399 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:53.516350 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1f233676-2ac3-4b52-b6c3-01926da0635b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:53.529368 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1f233676-2ac3-4b52-b6c3-01926da0635b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.293003 Aug 24 05:46:53.529368 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 156/315] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:53 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:53.529782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:53.546015 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:53.548640 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:53.550459 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6adb482d-fac2-4fd0-94d6-f569afc8e47e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.296305 Aug 24 05:46:53.555178 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 160/316] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:53 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:53.868073 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a38ae5d8-8369-45ee-9298-1bd996073ec5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:53.868858 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a38ae5d8-8369-45ee-9298-1bd996073ec5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:53.875463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a38ae5d8-8369-45ee-9298-1bd996073ec5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.876044 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a38ae5d8-8369-45ee-9298-1bd996073ec5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.877589 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a38ae5d8-8369-45ee-9298-1bd996073ec5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:53.878322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a38ae5d8-8369-45ee-9298-1bd996073ec5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.878788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a38ae5d8-8369-45ee-9298-1bd996073ec5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.879220 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a38ae5d8-8369-45ee-9298-1bd996073ec5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.053691 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a38ae5d8-8369-45ee-9298-1bd996073ec5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:54.066734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a38ae5d8-8369-45ee-9298-1bd996073ec5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.202658 Aug 24 05:46:54.067663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 157/317] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:53 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:54.549490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d93144ba-014a-494a-8397-7c19f2ec3daa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:54.550332 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d93144ba-014a-494a-8397-7c19f2ec3daa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:54.557705 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d93144ba-014a-494a-8397-7c19f2ec3daa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:54.558163 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d93144ba-014a-494a-8397-7c19f2ec3daa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:54.558890 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d93144ba-014a-494a-8397-7c19f2ec3daa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.559831 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d93144ba-014a-494a-8397-7c19f2ec3daa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:54.560669 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d93144ba-014a-494a-8397-7c19f2ec3daa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:54.561114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d93144ba-014a-494a-8397-7c19f2ec3daa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.580224 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:54.581693 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:54.596023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:54.597112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:54.598238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.600344 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:54.601821 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:54.602850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.821453 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d93144ba-014a-494a-8397-7c19f2ec3daa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:54.833818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d93144ba-014a-494a-8397-7c19f2ec3daa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.289128 Aug 24 05:46:54.835664 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 161/318] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:54 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:54.872820 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:54.890511 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:54.894374 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:54.897257 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3aa7bd21-e0ae-4e1f-bdff-d5ff36306916 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.325496 Aug 24 05:46:54.898354 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 158/319] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:54 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:55.038522 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-b1b561f1-6f53-4d03-8782-90202b5f0463 req-c4c519b3-5dd1-45c6-9ba9-f324c255e66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d92fba-9c39-4b5f-971f-83d972055316", "name": "network-vif-plugged", "status": "completed", "tag": "14ce7c9b-e214-4a48-bcb6-c730bc8b2303"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:55.054614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b1b561f1-6f53-4d03-8782-90202b5f0463 req-c4c519b3-5dd1-45c6-9ba9-f324c255e66f service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.056593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b1b561f1-6f53-4d03-8782-90202b5f0463 req-c4c519b3-5dd1-45c6-9ba9-f324c255e66f service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.057843 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b1b561f1-6f53-4d03-8782-90202b5f0463 req-c4c519b3-5dd1-45c6-9ba9-f324c255e66f service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.081500 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-b1b561f1-6f53-4d03-8782-90202b5f0463 req-c4c519b3-5dd1-45c6-9ba9-f324c255e66f service nova] Creating event network-vif-plugged:14ce7c9b-e214-4a48-bcb6-c730bc8b2303 for instance 27d92fba-9c39-4b5f-971f-83d972055316 on hv-cinder-85426 Aug 24 05:46:55.090624 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-b1b561f1-6f53-4d03-8782-90202b5f0463 req-c4c519b3-5dd1-45c6-9ba9-f324c255e66f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055333 Aug 24 05:46:55.091629 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 162/320] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:46:55.102896 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-45277cab-fa45-4795-b3d4-2934b9eb9b1f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:55.103208 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-45277cab-fa45-4795-b3d4-2934b9eb9b1f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:55.114522 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45277cab-fa45-4795-b3d4-2934b9eb9b1f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.115401 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45277cab-fa45-4795-b3d4-2934b9eb9b1f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.116194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45277cab-fa45-4795-b3d4-2934b9eb9b1f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.117528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45277cab-fa45-4795-b3d4-2934b9eb9b1f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.118348 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45277cab-fa45-4795-b3d4-2934b9eb9b1f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.119164 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45277cab-fa45-4795-b3d4-2934b9eb9b1f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.307488 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-45277cab-fa45-4795-b3d4-2934b9eb9b1f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:55.321125 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-45277cab-fa45-4795-b3d4-2934b9eb9b1f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.227278 Aug 24 05:46:55.322159 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 159/321] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:55 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:55.857313 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d1acfc1e-9d6e-47eb-a0d8-882e589528e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:55.858472 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d1acfc1e-9d6e-47eb-a0d8-882e589528e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:55.867969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1acfc1e-9d6e-47eb-a0d8-882e589528e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.868714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1acfc1e-9d6e-47eb-a0d8-882e589528e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.869447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1acfc1e-9d6e-47eb-a0d8-882e589528e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.870389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1acfc1e-9d6e-47eb-a0d8-882e589528e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.871017 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1acfc1e-9d6e-47eb-a0d8-882e589528e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.871684 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d1acfc1e-9d6e-47eb-a0d8-882e589528e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.930253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:55.939543 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:55.953878 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.958154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.958718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.959509 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.960055 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.960537 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:56.231106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d1acfc1e-9d6e-47eb-a0d8-882e589528e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:56.240797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d1acfc1e-9d6e-47eb-a0d8-882e589528e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.388927 Aug 24 05:46:56.241480 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 163/322] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:55 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:56.299512 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:56.318893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:56.318893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:56.318893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-edc09d19-2097-487d-8cbe-b840a0f7c7fe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.397915 Aug 24 05:46:56.319463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 160/323] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:55 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:56.343771 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1d6c8f43-3007-4903-b61c-7b1f7b0385fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:56.344497 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1d6c8f43-3007-4903-b61c-7b1f7b0385fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:56.352975 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d6c8f43-3007-4903-b61c-7b1f7b0385fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:56.353337 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d6c8f43-3007-4903-b61c-7b1f7b0385fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:56.353774 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d6c8f43-3007-4903-b61c-7b1f7b0385fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:56.354481 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d6c8f43-3007-4903-b61c-7b1f7b0385fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:56.354934 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d6c8f43-3007-4903-b61c-7b1f7b0385fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:56.355356 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d6c8f43-3007-4903-b61c-7b1f7b0385fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:56.514549 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1d6c8f43-3007-4903-b61c-7b1f7b0385fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:56.523273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1d6c8f43-3007-4903-b61c-7b1f7b0385fc tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.183911 Aug 24 05:46:56.524083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 164/324] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:56 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:57.263327 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6132671b-41c5-4e20-b82c-07f27487caf0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:57.263944 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6132671b-41c5-4e20-b82c-07f27487caf0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:57.271316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6132671b-41c5-4e20-b82c-07f27487caf0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:57.271802 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6132671b-41c5-4e20-b82c-07f27487caf0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:57.272236 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6132671b-41c5-4e20-b82c-07f27487caf0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:57.272969 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6132671b-41c5-4e20-b82c-07f27487caf0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:57.273704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6132671b-41c5-4e20-b82c-07f27487caf0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:57.274465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6132671b-41c5-4e20-b82c-07f27487caf0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:57.343273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:57.344072 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:57.354087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:57.355546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:57.356367 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:57.357413 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:57.358280 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:57.359045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:57.529651 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6132671b-41c5-4e20-b82c-07f27487caf0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:57.538048 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6132671b-41c5-4e20-b82c-07f27487caf0 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.278772 Aug 24 05:46:57.538626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 161/325] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:57 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:57.549897 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-662e0381-b484-4559-a895-bf494d35c149 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:57.550677 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-662e0381-b484-4559-a895-bf494d35c149 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:57.558854 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-662e0381-b484-4559-a895-bf494d35c149 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:57.558854 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-662e0381-b484-4559-a895-bf494d35c149 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:57.559674 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-662e0381-b484-4559-a895-bf494d35c149 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:57.564382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-662e0381-b484-4559-a895-bf494d35c149 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:57.564578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:57.564699 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-662e0381-b484-4559-a895-bf494d35c149 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:57.564699 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-662e0381-b484-4559-a895-bf494d35c149 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:57.570208 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:57.571819 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:57.573052 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e0862c72-c39c-4b9f-9bd5-02c5d2890ad2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.233787 Aug 24 05:46:57.573694 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 165/326] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:57 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:57.723504 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-662e0381-b484-4559-a895-bf494d35c149 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:57.732504 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-662e0381-b484-4559-a895-bf494d35c149 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.187370 Aug 24 05:46:57.733084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 162/327] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:57 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:58.562029 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-049e3257-13c5-479a-8c34-68bb97e90d6b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:58.562706 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-049e3257-13c5-479a-8c34-68bb97e90d6b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:58.572302 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049e3257-13c5-479a-8c34-68bb97e90d6b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:58.572832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049e3257-13c5-479a-8c34-68bb97e90d6b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:58.575147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049e3257-13c5-479a-8c34-68bb97e90d6b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:58.575147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049e3257-13c5-479a-8c34-68bb97e90d6b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:58.575147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049e3257-13c5-479a-8c34-68bb97e90d6b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:58.575147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049e3257-13c5-479a-8c34-68bb97e90d6b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:58.602675 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:58.603661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:58.628427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:58.628962 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:58.629409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:58.630481 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:58.631190 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:58.631908 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:58.845791 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-049e3257-13c5-479a-8c34-68bb97e90d6b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:58.868006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-049e3257-13c5-479a-8c34-68bb97e90d6b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.309649 Aug 24 05:46:58.875032 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 166/328] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:58 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:58.904216 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-edb6a2eb-e731-43d2-8b91-41fafe33bba9 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:58.905065 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-edb6a2eb-e731-43d2-8b91-41fafe33bba9 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:58.917702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:58.933577 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edb6a2eb-e731-43d2-8b91-41fafe33bba9 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:58.934361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edb6a2eb-e731-43d2-8b91-41fafe33bba9 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:58.935056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edb6a2eb-e731-43d2-8b91-41fafe33bba9 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:58.936037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edb6a2eb-e731-43d2-8b91-41fafe33bba9 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:58.937663 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edb6a2eb-e731-43d2-8b91-41fafe33bba9 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:58.938578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edb6a2eb-e731-43d2-8b91-41fafe33bba9 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:58.944155 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:58.952037 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:58.955285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-204e2b73-0cac-4194-b788-779aba62c548 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1406 microversion: 2.20 time: 0.361326 Aug 24 05:46:58.960138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 163/329] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:58 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:59.131506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-edb6a2eb-e731-43d2-8b91-41fafe33bba9 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:59.145322 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-edb6a2eb-e731-43d2-8b91-41fafe33bba9 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.268435 Aug 24 05:46:59.146086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 167/330] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:58 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:59.909902 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-016d2e60-85ed-4ade-aab8-ebc4f97c605a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:59.910855 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-016d2e60-85ed-4ade-aab8-ebc4f97c605a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:59.918321 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-016d2e60-85ed-4ade-aab8-ebc4f97c605a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:59.918845 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-016d2e60-85ed-4ade-aab8-ebc4f97c605a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:59.919287 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-016d2e60-85ed-4ade-aab8-ebc4f97c605a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:59.920027 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-016d2e60-85ed-4ade-aab8-ebc4f97c605a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:59.920530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-016d2e60-85ed-4ade-aab8-ebc4f97c605a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:59.920962 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-016d2e60-85ed-4ade-aab8-ebc4f97c605a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:00.006020 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:00.010368 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:00.027291 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:00.028527 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:00.030805 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:00.033478 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:00.034682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:00.035801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:00.125192 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-016d2e60-85ed-4ade-aab8-ebc4f97c605a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:00.139631 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-016d2e60-85ed-4ade-aab8-ebc4f97c605a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.234632 Aug 24 05:47:00.140463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 164/331] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:59 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:00.175963 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-446ae702-8de2-45f7-ac58-f4cd2f4cd482 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:00.177121 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-446ae702-8de2-45f7-ac58-f4cd2f4cd482 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:00.185353 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-446ae702-8de2-45f7-ac58-f4cd2f4cd482 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:00.186775 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-446ae702-8de2-45f7-ac58-f4cd2f4cd482 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:00.187924 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-446ae702-8de2-45f7-ac58-f4cd2f4cd482 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:00.190124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-446ae702-8de2-45f7-ac58-f4cd2f4cd482 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:00.191069 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-446ae702-8de2-45f7-ac58-f4cd2f4cd482 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:00.191923 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-446ae702-8de2-45f7-ac58-f4cd2f4cd482 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:00.328093 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:00.339172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:00.345242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:00.345242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-74aed711-362c-4023-b625-7ce9f7aa031d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1597 microversion: 2.20 time: 0.348863 Aug 24 05:47:00.345242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 168/332] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:59 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1597 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:47:00.368272 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ce68ff6c-df98-4e20-8756-a7287fed0de4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:00.368834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ce68ff6c-df98-4e20-8756-a7287fed0de4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:00.375277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce68ff6c-df98-4e20-8756-a7287fed0de4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:00.375787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce68ff6c-df98-4e20-8756-a7287fed0de4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:00.376511 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce68ff6c-df98-4e20-8756-a7287fed0de4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:00.378082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce68ff6c-df98-4e20-8756-a7287fed0de4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:00.378630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce68ff6c-df98-4e20-8756-a7287fed0de4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:00.379115 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce68ff6c-df98-4e20-8756-a7287fed0de4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:00.386700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-446ae702-8de2-45f7-ac58-f4cd2f4cd482 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:00.395338 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:00.399038 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:00.399498 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-446ae702-8de2-45f7-ac58-f4cd2f4cd482 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.232913 Aug 24 05:47:00.400236 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 165/333] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:00 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:00.481295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ce68ff6c-df98-4e20-8756-a7287fed0de4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.118082 Aug 24 05:47:00.482016 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 169/334] 10.222.0.15 () {60 vars in 1316 bytes} [Wed Aug 24 05:47:00 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:47:01.176764 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-5d260b8a-11b1-4229-af68-15f17844c493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:01.178967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5d260b8a-11b1-4229-af68-15f17844c493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:01.193771 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d260b8a-11b1-4229-af68-15f17844c493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:01.195758 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d260b8a-11b1-4229-af68-15f17844c493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:01.196528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d260b8a-11b1-4229-af68-15f17844c493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:01.197190 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d260b8a-11b1-4229-af68-15f17844c493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:01.197773 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d260b8a-11b1-4229-af68-15f17844c493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:01.209654 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d260b8a-11b1-4229-af68-15f17844c493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:01.429590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4e73cce6-6e4b-45fa-bb57-e2191fc5882f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:01.431295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4e73cce6-6e4b-45fa-bb57-e2191fc5882f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:01.447326 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5d260b8a-11b1-4229-af68-15f17844c493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:01.458063 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-5d260b8a-11b1-4229-af68-15f17844c493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.287546 Aug 24 05:47:01.459558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 166/335] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:01 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:01.472869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4e73cce6-6e4b-45fa-bb57-e2191fc5882f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:01.474116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4e73cce6-6e4b-45fa-bb57-e2191fc5882f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:01.475157 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4e73cce6-6e4b-45fa-bb57-e2191fc5882f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:01.476197 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4e73cce6-6e4b-45fa-bb57-e2191fc5882f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:01.476900 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4e73cce6-6e4b-45fa-bb57-e2191fc5882f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:01.477491 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4e73cce6-6e4b-45fa-bb57-e2191fc5882f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:01.569842 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-bbd8c890-fc34-43d7-a3a9-80a37b2cf5d9 req-d17e50f8-2b6d-4049-a649-8631fb95a23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d157837c-4de5-4853-91fd-5b8436d96436", "name": "network-vif-plugged", "status": "completed", "tag": "668e6922-ecd5-406a-b4cb-2ba3e6302727"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:01.584708 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-bbd8c890-fc34-43d7-a3a9-80a37b2cf5d9 req-d17e50f8-2b6d-4049-a649-8631fb95a23e service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:01.585424 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-bbd8c890-fc34-43d7-a3a9-80a37b2cf5d9 req-d17e50f8-2b6d-4049-a649-8631fb95a23e service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:01.586117 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-bbd8c890-fc34-43d7-a3a9-80a37b2cf5d9 req-d17e50f8-2b6d-4049-a649-8631fb95a23e service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:01.604362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-bbd8c890-fc34-43d7-a3a9-80a37b2cf5d9 req-d17e50f8-2b6d-4049-a649-8631fb95a23e service nova] Creating event network-vif-plugged:668e6922-ecd5-406a-b4cb-2ba3e6302727 for instance d157837c-4de5-4853-91fd-5b8436d96436 on hv-cinder-85426 Aug 24 05:47:01.611812 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-bbd8c890-fc34-43d7-a3a9-80a37b2cf5d9 req-d17e50f8-2b6d-4049-a649-8631fb95a23e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053680 Aug 24 05:47:01.612990 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 167/336] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:01.729618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4e73cce6-6e4b-45fa-bb57-e2191fc5882f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:01.741004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4e73cce6-6e4b-45fa-bb57-e2191fc5882f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.320784 Aug 24 05:47:01.742114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 170/337] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:01 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:02.341259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-6925aca9-ee61-40f6-96c4-81f15d7d340e req-d8c029ec-a762-4a54-a4a4-507a07fc7da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27d92fba-9c39-4b5f-971f-83d972055316", "tag": "14ce7c9b-e214-4a48-bcb6-c730bc8b2303"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:02.359666 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-6925aca9-ee61-40f6-96c4-81f15d7d340e req-d8c029ec-a762-4a54-a4a4-507a07fc7da0 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:02.360620 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-6925aca9-ee61-40f6-96c4-81f15d7d340e req-d8c029ec-a762-4a54-a4a4-507a07fc7da0 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:02.361319 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-6925aca9-ee61-40f6-96c4-81f15d7d340e req-d8c029ec-a762-4a54-a4a4-507a07fc7da0 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:02.375992 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-6925aca9-ee61-40f6-96c4-81f15d7d340e req-d8c029ec-a762-4a54-a4a4-507a07fc7da0 service nova] Creating event network-changed:14ce7c9b-e214-4a48-bcb6-c730bc8b2303 for instance 27d92fba-9c39-4b5f-971f-83d972055316 on hv-cinder-85426 Aug 24 05:47:02.382484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-6925aca9-ee61-40f6-96c4-81f15d7d340e req-d8c029ec-a762-4a54-a4a4-507a07fc7da0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045232 Aug 24 05:47:02.383421 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 168/338] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:02.504766 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fa76e57c-352b-4e50-9a62-230684c0f8ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:02.504766 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-fa76e57c-352b-4e50-9a62-230684c0f8ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:02.555655 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa76e57c-352b-4e50-9a62-230684c0f8ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:02.555655 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa76e57c-352b-4e50-9a62-230684c0f8ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:02.555655 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa76e57c-352b-4e50-9a62-230684c0f8ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:02.559300 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa76e57c-352b-4e50-9a62-230684c0f8ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:02.559901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa76e57c-352b-4e50-9a62-230684c0f8ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:02.560471 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa76e57c-352b-4e50-9a62-230684c0f8ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:02.781276 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-5413995b-7583-4143-94b9-d9448da243a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:02.783745 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5413995b-7583-4143-94b9-d9448da243a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:02.793132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-fa76e57c-352b-4e50-9a62-230684c0f8ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:02.803626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-fa76e57c-352b-4e50-9a62-230684c0f8ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.308940 Aug 24 05:47:02.806044 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5413995b-7583-4143-94b9-d9448da243a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:02.806690 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 171/339] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:02 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:02.807391 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5413995b-7583-4143-94b9-d9448da243a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:02.807992 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5413995b-7583-4143-94b9-d9448da243a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:02.809016 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5413995b-7583-4143-94b9-d9448da243a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:02.809847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5413995b-7583-4143-94b9-d9448da243a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:02.810515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5413995b-7583-4143-94b9-d9448da243a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:02.995017 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5413995b-7583-4143-94b9-d9448da243a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:03.004071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-5413995b-7583-4143-94b9-d9448da243a5 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.235666 Aug 24 05:47:03.005022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 169/340] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:02 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:03.842217 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-11ed9b1e-eae7-48f1-b354-a4dd898cec85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:03.843014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-11ed9b1e-eae7-48f1-b354-a4dd898cec85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:03.850961 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11ed9b1e-eae7-48f1-b354-a4dd898cec85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:03.851609 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11ed9b1e-eae7-48f1-b354-a4dd898cec85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:03.852252 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11ed9b1e-eae7-48f1-b354-a4dd898cec85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:03.853326 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11ed9b1e-eae7-48f1-b354-a4dd898cec85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:03.853867 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11ed9b1e-eae7-48f1-b354-a4dd898cec85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:03.854250 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11ed9b1e-eae7-48f1-b354-a4dd898cec85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:04.026374 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ab2f1aca-dbed-4cc7-b4bb-daf5939decbe tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:04.035137 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ab2f1aca-dbed-4cc7-b4bb-daf5939decbe tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:04.051993 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-11ed9b1e-eae7-48f1-b354-a4dd898cec85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:04.062094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2f1aca-dbed-4cc7-b4bb-daf5939decbe tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:04.062713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2f1aca-dbed-4cc7-b4bb-daf5939decbe tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:04.063168 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2f1aca-dbed-4cc7-b4bb-daf5939decbe tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:04.064014 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2f1aca-dbed-4cc7-b4bb-daf5939decbe tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:04.065266 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2f1aca-dbed-4cc7-b4bb-daf5939decbe tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:04.068482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2f1aca-dbed-4cc7-b4bb-daf5939decbe tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:04.077943 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-11ed9b1e-eae7-48f1-b354-a4dd898cec85 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.239577 Aug 24 05:47:04.079047 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 172/341] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:03 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:04.230455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ab2f1aca-dbed-4cc7-b4bb-daf5939decbe tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:04.242026 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ab2f1aca-dbed-4cc7-b4bb-daf5939decbe tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.218900 Aug 24 05:47:04.242656 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 170/342] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:04 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:05.114165 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4201d2e7-faee-43fd-97bb-3dcc2211288d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:05.114851 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4201d2e7-faee-43fd-97bb-3dcc2211288d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:05.122592 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4201d2e7-faee-43fd-97bb-3dcc2211288d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:05.123089 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4201d2e7-faee-43fd-97bb-3dcc2211288d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:05.123533 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4201d2e7-faee-43fd-97bb-3dcc2211288d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:05.124251 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4201d2e7-faee-43fd-97bb-3dcc2211288d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:05.124742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4201d2e7-faee-43fd-97bb-3dcc2211288d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:05.125174 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4201d2e7-faee-43fd-97bb-3dcc2211288d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:05.269032 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-77d4a9a5-fe1a-4d31-9164-69304069f08f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:05.269850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-77d4a9a5-fe1a-4d31-9164-69304069f08f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:05.276958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77d4a9a5-fe1a-4d31-9164-69304069f08f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:05.277580 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77d4a9a5-fe1a-4d31-9164-69304069f08f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:05.278127 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77d4a9a5-fe1a-4d31-9164-69304069f08f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:05.278875 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77d4a9a5-fe1a-4d31-9164-69304069f08f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:05.279344 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77d4a9a5-fe1a-4d31-9164-69304069f08f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:05.279776 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77d4a9a5-fe1a-4d31-9164-69304069f08f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:05.302769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4201d2e7-faee-43fd-97bb-3dcc2211288d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:05.311318 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4201d2e7-faee-43fd-97bb-3dcc2211288d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.202447 Aug 24 05:47:05.311915 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 173/343] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:05 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:05.453323 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-77d4a9a5-fe1a-4d31-9164-69304069f08f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:05.470855 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-77d4a9a5-fe1a-4d31-9164-69304069f08f tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.205735 Aug 24 05:47:05.471391 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 171/344] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:05 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:06.336274 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e436e70d-b293-45be-93a3-cd48fea7c4aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:06.336970 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e436e70d-b293-45be-93a3-cd48fea7c4aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:06.344317 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e436e70d-b293-45be-93a3-cd48fea7c4aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.344510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e436e70d-b293-45be-93a3-cd48fea7c4aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.345555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e436e70d-b293-45be-93a3-cd48fea7c4aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.346338 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e436e70d-b293-45be-93a3-cd48fea7c4aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.346886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e436e70d-b293-45be-93a3-cd48fea7c4aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.347359 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e436e70d-b293-45be-93a3-cd48fea7c4aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.494676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-87b1b01b-b9b1-48a2-bc33-d63df7ac6ff3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:06.495615 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-87b1b01b-b9b1-48a2-bc33-d63df7ac6ff3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:06.496714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e436e70d-b293-45be-93a3-cd48fea7c4aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:06.508024 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-87b1b01b-b9b1-48a2-bc33-d63df7ac6ff3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.509690 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-87b1b01b-b9b1-48a2-bc33-d63df7ac6ff3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.510960 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-87b1b01b-b9b1-48a2-bc33-d63df7ac6ff3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.512021 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-87b1b01b-b9b1-48a2-bc33-d63df7ac6ff3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.512152 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e436e70d-b293-45be-93a3-cd48fea7c4aa tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1502 microversion: 2.1 time: 0.180163 Aug 24 05:47:06.512941 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-87b1b01b-b9b1-48a2-bc33-d63df7ac6ff3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.513598 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-87b1b01b-b9b1-48a2-bc33-d63df7ac6ff3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.532442 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 174/345] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:06 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:06.557556 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14de80e5-4246-4c3d-94ab-dbf655004a39"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:06.562085 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:06.573803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.575135 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.576340 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.578006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.578849 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.580277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.627045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] HTTP exception thrown: Cannot 'attach_volume' instance 876be02b-9b39-4f01-9650-28904167d60f while it is in vm_state rescued Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Request method failure captured: Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: POST /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f/os-volume_attachments HTTP/1.1 Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 74 Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrJzcprHqQlE5leVvGfV6xgwH1tOW0OIj8bhIII0tPRpVgD4vrhN0TkXcTjl15pHeEFXnr9AQBXPxDdB2BYsR5TOA76YGfCuwpJD9i-Sssl_bP9CSaMttD_juz07C2hdpqvtLcP6hER3DOwih0w66MhihvnUtIVn_DOGnwbrS6REzc Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 39a99050c88d48db851f437f68b65a58 Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:47:06.630995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_39a99050c88d48db851f437f68b65a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a99050c88d48db851f437f68b65a58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/39a99050c88d48db851f437f68b65a58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a99050c88d48db851f437f68b65a58"}]}] Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 39a99050c88d48db851f437f68b65a58 Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-ServerRescueNegativeTestJSON-1927483895-project Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 926115c2e54741e6a3aca02437309b8f Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1927483895-project Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {"volumeAttachment": {"volumeId": "14de80e5-4246-4c3d-94ab-dbf655004a39"}} Aug 24 05:47:06.632362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Cannot 'attach_volume' instance 876be02b-9b39-4f01-9650-28904167d60f while it is in vm_state rescued Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'server_id': '876be02b-9b39-4f01-9650-28904167d60f', 'body': {'volumeAttachment': {'volumeId': '14de80e5-4246-4c3d-94ab-dbf655004a39'}}} Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 876be02b-9b39-4f01-9650-28904167d60f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:47:06.633215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 876be02b-9b39-4f01-9650-28904167d60f while it is in vm_state rescued Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:06.634626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:06.635966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:47:06.635966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:47:06.635966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 876be02b-9b39-4f01-9650-28904167d60f while it is in vm_state rescued Aug 24 05:47:06.635966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:47:06.635966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Returning 409 to user: Cannot 'attach_volume' instance 876be02b-9b39-4f01-9650-28904167d60f while it is in vm_state rescued {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:47:06.635966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-79e7be53-e304-4e49-8222-b57f533b9b10 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "POST /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.085701 Aug 24 05:47:06.637858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 175/346] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 05:47:06 2022] POST /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 05:47:06.646491 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-075998e7-281f-4899-8a1e-8072c182b808 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:06.647223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-075998e7-281f-4899-8a1e-8072c182b808 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:06.654297 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-075998e7-281f-4899-8a1e-8072c182b808 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.654773 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-075998e7-281f-4899-8a1e-8072c182b808 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.655202 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-075998e7-281f-4899-8a1e-8072c182b808 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.655889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-075998e7-281f-4899-8a1e-8072c182b808 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.656366 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-075998e7-281f-4899-8a1e-8072c182b808 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.656839 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-075998e7-281f-4899-8a1e-8072c182b808 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.697734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-87b1b01b-b9b1-48a2-bc33-d63df7ac6ff3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:06.709108 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-87b1b01b-b9b1-48a2-bc33-d63df7ac6ff3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1313 microversion: 2.1 time: 0.221077 Aug 24 05:47:06.710206 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 172/347] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:06 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:07.083300 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-075998e7-281f-4899-8a1e-8072c182b808 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "POST /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f/action" status: 202 len: 0 microversion: 2.1 time: 0.441352 Aug 24 05:47:07.084029 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 176/348] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:47:06 2022] POST /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:47:07.092706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6ff9be67-d81e-4882-878d-5c46f672db30 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:07.093631 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6ff9be67-d81e-4882-878d-5c46f672db30 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:07.101235 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ff9be67-d81e-4882-878d-5c46f672db30 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.101733 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ff9be67-d81e-4882-878d-5c46f672db30 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.102178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ff9be67-d81e-4882-878d-5c46f672db30 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.102917 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ff9be67-d81e-4882-878d-5c46f672db30 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.103376 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ff9be67-d81e-4882-878d-5c46f672db30 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.103806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ff9be67-d81e-4882-878d-5c46f672db30 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.247687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6ff9be67-d81e-4882-878d-5c46f672db30 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:07.263671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6ff9be67-d81e-4882-878d-5c46f672db30 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1510 microversion: 2.1 time: 0.174839 Aug 24 05:47:07.264516 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 173/349] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:07 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:07.731269 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d97e5ef8-e540-4064-bc79-d3c123419b3b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:07.732022 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d97e5ef8-e540-4064-bc79-d3c123419b3b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:07.741010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d97e5ef8-e540-4064-bc79-d3c123419b3b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.742637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d97e5ef8-e540-4064-bc79-d3c123419b3b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.743153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d97e5ef8-e540-4064-bc79-d3c123419b3b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.744678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d97e5ef8-e540-4064-bc79-d3c123419b3b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.747544 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d97e5ef8-e540-4064-bc79-d3c123419b3b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.748840 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d97e5ef8-e540-4064-bc79-d3c123419b3b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.910155 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d97e5ef8-e540-4064-bc79-d3c123419b3b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:07.919781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d97e5ef8-e540-4064-bc79-d3c123419b3b tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1497 microversion: 2.1 time: 0.192339 Aug 24 05:47:07.920372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 177/350] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:07 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:08.292721 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9332da7d-9a31-4f1b-a76e-2a5e94be6139 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:08.293352 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9332da7d-9a31-4f1b-a76e-2a5e94be6139 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:08.303623 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9332da7d-9a31-4f1b-a76e-2a5e94be6139 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:08.305598 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9332da7d-9a31-4f1b-a76e-2a5e94be6139 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:08.306016 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9332da7d-9a31-4f1b-a76e-2a5e94be6139 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:08.307022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9332da7d-9a31-4f1b-a76e-2a5e94be6139 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:08.307539 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9332da7d-9a31-4f1b-a76e-2a5e94be6139 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:08.307981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9332da7d-9a31-4f1b-a76e-2a5e94be6139 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:08.471481 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9332da7d-9a31-4f1b-a76e-2a5e94be6139 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:08.482664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9332da7d-9a31-4f1b-a76e-2a5e94be6139 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1510 microversion: 2.1 time: 0.197635 Aug 24 05:47:08.482664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 174/351] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:08 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:09.075667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-02e9b435-3ae7-4a5f-b97c-e353d354f5f2 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:09.076916 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-02e9b435-3ae7-4a5f-b97c-e353d354f5f2 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:09.084925 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02e9b435-3ae7-4a5f-b97c-e353d354f5f2 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:09.085437 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02e9b435-3ae7-4a5f-b97c-e353d354f5f2 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:09.085885 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02e9b435-3ae7-4a5f-b97c-e353d354f5f2 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:09.086596 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02e9b435-3ae7-4a5f-b97c-e353d354f5f2 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:09.087059 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02e9b435-3ae7-4a5f-b97c-e353d354f5f2 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:09.087493 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-02e9b435-3ae7-4a5f-b97c-e353d354f5f2 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:09.117833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-02e9b435-3ae7-4a5f-b97c-e353d354f5f2 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Going to try to terminate instance {{(pid=127756) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:47:09.515165 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ac0748b9-2ba8-457d-a3a3-873e7d8f1dd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:09.517440 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ac0748b9-2ba8-457d-a3a3-873e7d8f1dd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:09.530524 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ac0748b9-2ba8-457d-a3a3-873e7d8f1dd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:09.531709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ac0748b9-2ba8-457d-a3a3-873e7d8f1dd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:09.533626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ac0748b9-2ba8-457d-a3a3-873e7d8f1dd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:09.534504 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ac0748b9-2ba8-457d-a3a3-873e7d8f1dd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:09.535850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ac0748b9-2ba8-457d-a3a3-873e7d8f1dd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:09.538238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ac0748b9-2ba8-457d-a3a3-873e7d8f1dd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:09.691201 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ac0748b9-2ba8-457d-a3a3-873e7d8f1dd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:09.699316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ac0748b9-2ba8-457d-a3a3-873e7d8f1dd3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1510 microversion: 2.1 time: 0.193963 Aug 24 05:47:09.699880 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 175/352] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:09 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:09.994580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-02e9b435-3ae7-4a5f-b97c-e353d354f5f2 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 204 len: 0 microversion: 2.1 time: 0.922598 Aug 24 05:47:09.995163 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 178/353] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:47:09 2022] DELETE /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:47:10.012643 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-eb7a11f9-7161-489a-b5d0-fdb1dd8fb690 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:10.012643 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-eb7a11f9-7161-489a-b5d0-fdb1dd8fb690 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:10.014671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb7a11f9-7161-489a-b5d0-fdb1dd8fb690 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:10.015184 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb7a11f9-7161-489a-b5d0-fdb1dd8fb690 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:10.015650 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb7a11f9-7161-489a-b5d0-fdb1dd8fb690 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:10.016373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb7a11f9-7161-489a-b5d0-fdb1dd8fb690 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:10.016904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb7a11f9-7161-489a-b5d0-fdb1dd8fb690 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:10.017591 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eb7a11f9-7161-489a-b5d0-fdb1dd8fb690 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:10.217420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-eb7a11f9-7161-489a-b5d0-fdb1dd8fb690 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:10.226795 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-eb7a11f9-7161-489a-b5d0-fdb1dd8fb690 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1503 microversion: 2.1 time: 0.227021 Aug 24 05:47:10.228730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 176/354] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:09 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:10.723469 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3d1c0f3d-a74f-4318-a5ea-7ae2e0db7c50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:10.725231 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3d1c0f3d-a74f-4318-a5ea-7ae2e0db7c50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:10.732585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1c0f3d-a74f-4318-a5ea-7ae2e0db7c50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:10.733159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1c0f3d-a74f-4318-a5ea-7ae2e0db7c50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:10.733514 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1c0f3d-a74f-4318-a5ea-7ae2e0db7c50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:10.734320 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1c0f3d-a74f-4318-a5ea-7ae2e0db7c50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:10.734807 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1c0f3d-a74f-4318-a5ea-7ae2e0db7c50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:10.735235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1c0f3d-a74f-4318-a5ea-7ae2e0db7c50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:10.916882 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3d1c0f3d-a74f-4318-a5ea-7ae2e0db7c50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:10.931037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3d1c0f3d-a74f-4318-a5ea-7ae2e0db7c50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1510 microversion: 2.1 time: 0.213256 Aug 24 05:47:10.931608 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 179/355] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:10 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:11.252040 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-43366678-dd44-45e9-a46c-78afd861b7a1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:11.254841 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-43366678-dd44-45e9-a46c-78afd861b7a1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:11.261084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43366678-dd44-45e9-a46c-78afd861b7a1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.261568 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43366678-dd44-45e9-a46c-78afd861b7a1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.262006 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43366678-dd44-45e9-a46c-78afd861b7a1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:11.262705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43366678-dd44-45e9-a46c-78afd861b7a1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.263155 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43366678-dd44-45e9-a46c-78afd861b7a1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.263576 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-43366678-dd44-45e9-a46c-78afd861b7a1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:11.428807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-43366678-dd44-45e9-a46c-78afd861b7a1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:11.438495 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-43366678-dd44-45e9-a46c-78afd861b7a1 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1503 microversion: 2.1 time: 0.192000 Aug 24 05:47:11.439080 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 177/356] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:11 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:11.953841 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c674c46e-c994-4c69-ae24-62d631d0e708 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:11.954373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c674c46e-c994-4c69-ae24-62d631d0e708 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:11.957740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:11.963805 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c674c46e-c994-4c69-ae24-62d631d0e708 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.964429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c674c46e-c994-4c69-ae24-62d631d0e708 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.968656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c674c46e-c994-4c69-ae24-62d631d0e708 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:11.968656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c674c46e-c994-4c69-ae24-62d631d0e708 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.968656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c674c46e-c994-4c69-ae24-62d631d0e708 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.968656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c674c46e-c994-4c69-ae24-62d631d0e708 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:12.141521 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c674c46e-c994-4c69-ae24-62d631d0e708 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:12.150543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c674c46e-c994-4c69-ae24-62d631d0e708 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1510 microversion: 2.1 time: 0.200868 Aug 24 05:47:12.151127 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 180/357] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:11 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:12.461518 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0851dbb4-55d2-4e2c-a1df-ea6adce9a4f3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:12.462679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0851dbb4-55d2-4e2c-a1df-ea6adce9a4f3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:12.470223 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0851dbb4-55d2-4e2c-a1df-ea6adce9a4f3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:12.470740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0851dbb4-55d2-4e2c-a1df-ea6adce9a4f3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:12.470900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0851dbb4-55d2-4e2c-a1df-ea6adce9a4f3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:12.471700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0851dbb4-55d2-4e2c-a1df-ea6adce9a4f3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:12.472528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0851dbb4-55d2-4e2c-a1df-ea6adce9a4f3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:12.473129 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0851dbb4-55d2-4e2c-a1df-ea6adce9a4f3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:12.625187 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0851dbb4-55d2-4e2c-a1df-ea6adce9a4f3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:12.637369 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0851dbb4-55d2-4e2c-a1df-ea6adce9a4f3 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1503 microversion: 2.1 time: 0.180408 Aug 24 05:47:12.638180 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 178/358] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:12 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:13.173657 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c2744ebd-c917-460b-b83a-1f0fb4bd5993 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:13.174323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c2744ebd-c917-460b-b83a-1f0fb4bd5993 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:13.185225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c2744ebd-c917-460b-b83a-1f0fb4bd5993 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:13.185733 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c2744ebd-c917-460b-b83a-1f0fb4bd5993 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:13.186179 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c2744ebd-c917-460b-b83a-1f0fb4bd5993 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:13.186913 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c2744ebd-c917-460b-b83a-1f0fb4bd5993 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:13.187352 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c2744ebd-c917-460b-b83a-1f0fb4bd5993 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:13.187782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c2744ebd-c917-460b-b83a-1f0fb4bd5993 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:13.342620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c2744ebd-c917-460b-b83a-1f0fb4bd5993 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:13.357665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c2744ebd-c917-460b-b83a-1f0fb4bd5993 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1510 microversion: 2.1 time: 0.187341 Aug 24 05:47:13.359021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 181/359] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:13 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:13.661439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3573a349-7b2c-4b0f-8ade-9c36d3710222 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:13.662125 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3573a349-7b2c-4b0f-8ade-9c36d3710222 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:13.669238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3573a349-7b2c-4b0f-8ade-9c36d3710222 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:13.669730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3573a349-7b2c-4b0f-8ade-9c36d3710222 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:13.670174 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3573a349-7b2c-4b0f-8ade-9c36d3710222 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:13.670901 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3573a349-7b2c-4b0f-8ade-9c36d3710222 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:13.671354 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3573a349-7b2c-4b0f-8ade-9c36d3710222 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:13.671787 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3573a349-7b2c-4b0f-8ade-9c36d3710222 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:13.875667 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3573a349-7b2c-4b0f-8ade-9c36d3710222 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:13.887906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3573a349-7b2c-4b0f-8ade-9c36d3710222 tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1503 microversion: 2.1 time: 0.231988 Aug 24 05:47:13.888894 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 179/360] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:13 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:14.389845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d09c8b26-605f-4fdd-8134-2aa994966e17 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:14.402750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d09c8b26-605f-4fdd-8134-2aa994966e17 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:14.411361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d09c8b26-605f-4fdd-8134-2aa994966e17 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.414674 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d09c8b26-605f-4fdd-8134-2aa994966e17 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.415435 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d09c8b26-605f-4fdd-8134-2aa994966e17 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.416387 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d09c8b26-605f-4fdd-8134-2aa994966e17 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.417048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d09c8b26-605f-4fdd-8134-2aa994966e17 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.417910 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d09c8b26-605f-4fdd-8134-2aa994966e17 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.600902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d09c8b26-605f-4fdd-8134-2aa994966e17 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:14.609528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d09c8b26-605f-4fdd-8134-2aa994966e17 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1516 microversion: 2.1 time: 0.228676 Aug 24 05:47:14.610096 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 182/361] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:14 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:14.913593 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a3513696-ca46-4794-a30b-c06ef17e19ab tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:14.914706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a3513696-ca46-4794-a30b-c06ef17e19ab tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:14.924112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a3513696-ca46-4794-a30b-c06ef17e19ab tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.924832 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a3513696-ca46-4794-a30b-c06ef17e19ab tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.925293 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a3513696-ca46-4794-a30b-c06ef17e19ab tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.926022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a3513696-ca46-4794-a30b-c06ef17e19ab tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.927331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a3513696-ca46-4794-a30b-c06ef17e19ab tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.927783 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a3513696-ca46-4794-a30b-c06ef17e19ab tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:15.140678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a3513696-ca46-4794-a30b-c06ef17e19ab tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:15.154063 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a3513696-ca46-4794-a30b-c06ef17e19ab tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1503 microversion: 2.1 time: 0.246673 Aug 24 05:47:15.154903 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 180/362] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:14 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:16.149543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-78d30e42-aadd-4b3e-af5e-960e077197b3 req-bf5d7ee0-b6da-47e8-87ff-5239db419103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d157837c-4de5-4853-91fd-5b8436d96436", "name": "network-vif-deleted", "tag": "668e6922-ecd5-406a-b4cb-2ba3e6302727"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:16.163841 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-78d30e42-aadd-4b3e-af5e-960e077197b3 req-bf5d7ee0-b6da-47e8-87ff-5239db419103 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.164814 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-78d30e42-aadd-4b3e-af5e-960e077197b3 req-bf5d7ee0-b6da-47e8-87ff-5239db419103 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.165789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-78d30e42-aadd-4b3e-af5e-960e077197b3 req-bf5d7ee0-b6da-47e8-87ff-5239db419103 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.185321 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-07921fc6-3779-45e0-9c89-eac683063d9e tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:16.186469 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-07921fc6-3779-45e0-9c89-eac683063d9e tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:16.193587 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=76 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:16.197663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07921fc6-3779-45e0-9c89-eac683063d9e tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.197663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07921fc6-3779-45e0-9c89-eac683063d9e tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.197663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07921fc6-3779-45e0-9c89-eac683063d9e tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.198738 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07921fc6-3779-45e0-9c89-eac683063d9e tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.203492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07921fc6-3779-45e0-9c89-eac683063d9e tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.207703 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07921fc6-3779-45e0-9c89-eac683063d9e tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.210374 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-78d30e42-aadd-4b3e-af5e-960e077197b3 req-bf5d7ee0-b6da-47e8-87ff-5239db419103 service nova] Creating event network-vif-deleted:668e6922-ecd5-406a-b4cb-2ba3e6302727 for instance d157837c-4de5-4853-91fd-5b8436d96436 on hv-cinder-85426 Aug 24 05:47:16.216332 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-78d30e42-aadd-4b3e-af5e-960e077197b3 req-bf5d7ee0-b6da-47e8-87ff-5239db419103 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074809 Aug 24 05:47:16.217730 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 183/363] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:16.288050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-07921fc6-3779-45e0-9c89-eac683063d9e tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:16.296496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-07921fc6-3779-45e0-9c89-eac683063d9e tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1461 microversion: 2.1 time: 0.119379 Aug 24 05:47:16.297078 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 181/364] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:16 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1461 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:17.321883 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:17.322654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:17.329308 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:17.329813 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:17.330246 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:17.331733 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:17.332563 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:17.333050 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:17.375042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:17.376705 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:17.377162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:17.378158 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lazy-loading 'fault' on Instance uuid d157837c-4de5-4853-91fd-5b8436d96436 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:47:17.380633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:17.430810 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c85840c4d104b04b6ed577cce2ca2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43149d6590a6468b83faa5f1cd7c6b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:17.445977 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7767d1e7-3fdd-470a-b484-0d9e4f38d17a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 200 len: 1303 microversion: 2.1 time: 0.129197 Aug 24 05:47:17.456998 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 184/365] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:17 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:17.631580 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-fb647adc-ff0b-4586-964c-433d3a2e1b3d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Action: 'create', calling method: .version_select at 0x7f065ccd8940>, body: {"keypair": {"name": "tempest-keypair-994994310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLntMPTA6pH+EIh7+xyLs0unvlWhPdv1y5FTfIszllLTxTiJA4x1AzksiRcm6sgEyJzrtlB/lKJRbRKTXLZ6grAx/D33/MPwU+JjVlaq9SgsPj1asYk+My/pa2vGKvbhcw=="}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:17.659955 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-fb647adc-ff0b-4586-964c-433d3a2e1b3d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Getting quotas for project 39a99050c88d48db851f437f68b65a58. Resources: {'key_pairs'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:47:17.664689 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-fb647adc-ff0b-4586-964c-433d3a2e1b3d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Getting quotas for user 926115c2e54741e6a3aca02437309b8f and project 39a99050c88d48db851f437f68b65a58. Resources: {'key_pairs'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:47:17.829218 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-fb647adc-ff0b-4586-964c-433d3a2e1b3d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.178397 Aug 24 05:47:17.829218 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 182/366] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 24 05:47:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:18.469740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:18.470457 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] [instance: d157837c-4de5-4853-91fd-5b8436d96436] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:18.481078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:18.481444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:18.481911 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:18.482642 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:18.483086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:18.483588 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:18.499312 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] HTTP exception thrown: Instance d157837c-4de5-4853-91fd-5b8436d96436 could not be found. Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Request method failure captured: Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 HTTP/1.1 Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbsULLZAwvyVdDhlCzb2-5roKKB1QhJ7vL3-kWE6KbNh3UZp1ZD8LT8-j0ituw5EZGK29HVp_f2oI_Ch9MwtUpkD6vIQjo4O4ueWkwyhH0r0g_4zLuLUm8Mw_dxuu4lxsYPy_jHK96T-NeKfEx0Iu9SNFQDi_UC5Tr0-MCMnH36IxoE Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 43149d6590a6468b83faa5f1cd7c6b59 Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-VolumesActionsTest-400159807 Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:47:18.501035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_43149d6590a6468b83faa5f1cd7c6b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/43149d6590a6468b83faa5f1cd7c6b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/43149d6590a6468b83faa5f1cd7c6b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/43149d6590a6468b83faa5f1cd7c6b59"}]}] Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-VolumesActionsTest-400159807 Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 43149d6590a6468b83faa5f1cd7c6b59 Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-VolumesActionsTest-400159807 Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-VolumesActionsTest-400159807-project Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 1c85840c4d104b04b6ed577cce2ca2ff Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-VolumesActionsTest-400159807-project Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance d157837c-4de5-4853-91fd-5b8436d96436 could not be found. Aug 24 05:47:18.502675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': 'd157837c-4de5-4853-91fd-5b8436d96436'} Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d157837c-4de5-4853-91fd-5b8436d96436 could not be found. Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:47:18.503466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d157837c-4de5-4853-91fd-5b8436d96436 could not be found. Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d157837c-4de5-4853-91fd-5b8436d96436 could not be found. Aug 24 05:47:18.505132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:47:18.506517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] Returning 404 to user: Instance d157837c-4de5-4853-91fd-5b8436d96436 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:47:18.506517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-53b6c186-0e50-4343-9a6c-2e2266b2235a tempest-VolumesActionsTest-400159807 tempest-VolumesActionsTest-400159807-project] 10.222.0.15 "GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436" status: 404 len: 111 microversion: 2.1 time: 0.036642 Aug 24 05:47:18.508120 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 185/367] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:18 2022] GET /compute/v2.1/servers/d157837c-4de5-4853-91fd-5b8436d96436 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:47:21.601419 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1515114541", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5a09cc1-27f9-4801-826b-d1e4f52ed502"}], "security_groups": [{"name": "tempest-securitygroup--706339467"}], "key_name": "tempest-keypair-994994310", "user_data": "}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:21.740381 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] validate_networks() for [('f5a09cc1-27f9-4801-826b-d1e4f52ed502', None, None, None, None, None)] {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:47:22.386007 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:47:22.386459 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:47:22.386947 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:47:22.387359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:47:22.387799 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:47:22.397497 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:22.399109 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:22.399552 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:22.400290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:22.400798 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:22.401221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:22.425572 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Getting quotas for project 39a99050c88d48db851f437f68b65a58. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:47:22.432386 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Getting quotas for user 926115c2e54741e6a3aca02437309b8f and project 39a99050c88d48db851f437f68b65a58. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:47:22.445530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:47:22.448249 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:47:22.775627 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f85c91f3-79fe-47f1-8e8b-b89c766b2ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.180048 Aug 24 05:47:22.776646 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 183/368] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:47:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:47:22.790377 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5578b791-e839-45bb-9e41-f47173c5b65f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:22.795750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5578b791-e839-45bb-9e41-f47173c5b65f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:22.891137 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5578b791-e839-45bb-9e41-f47173c5b65f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:22.902038 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5578b791-e839-45bb-9e41-f47173c5b65f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1245 microversion: 2.1 time: 0.118417 Aug 24 05:47:22.904997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 186/369] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:22 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:23.928004 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8aec10cc-b0be-4c77-bf5f-7ad4a5a9760b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:23.928004 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8aec10cc-b0be-4c77-bf5f-7ad4a5a9760b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:24.033873 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8aec10cc-b0be-4c77-bf5f-7ad4a5a9760b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:24.042071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8aec10cc-b0be-4c77-bf5f-7ad4a5a9760b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1245 microversion: 2.1 time: 0.121209 Aug 24 05:47:24.043381 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 184/370] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:23 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1245 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:25.065607 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-66a88651-d01d-423b-a9b6-f4feaa9c8dd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:25.067124 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-66a88651-d01d-423b-a9b6-f4feaa9c8dd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:25.075762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66a88651-d01d-423b-a9b6-f4feaa9c8dd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:25.076642 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66a88651-d01d-423b-a9b6-f4feaa9c8dd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:25.077307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66a88651-d01d-423b-a9b6-f4feaa9c8dd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:25.078258 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66a88651-d01d-423b-a9b6-f4feaa9c8dd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:25.078928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66a88651-d01d-423b-a9b6-f4feaa9c8dd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:25.079373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66a88651-d01d-423b-a9b6-f4feaa9c8dd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:25.410349 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66a88651-d01d-423b-a9b6-f4feaa9c8dd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:25.419078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-66a88651-d01d-423b-a9b6-f4feaa9c8dd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1249 microversion: 2.1 time: 0.357778 Aug 24 05:47:25.419672 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 187/371] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:25 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1249 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:26.446934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-de23ced5-d78e-42b9-b661-7f2ef43e4f1b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:26.447743 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-de23ced5-d78e-42b9-b661-7f2ef43e4f1b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:26.455051 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-de23ced5-d78e-42b9-b661-7f2ef43e4f1b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:26.455638 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-de23ced5-d78e-42b9-b661-7f2ef43e4f1b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:26.456311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-de23ced5-d78e-42b9-b661-7f2ef43e4f1b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:26.457339 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-de23ced5-d78e-42b9-b661-7f2ef43e4f1b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:26.457879 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-de23ced5-d78e-42b9-b661-7f2ef43e4f1b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:26.458393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-de23ced5-d78e-42b9-b661-7f2ef43e4f1b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:26.557682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-de23ced5-d78e-42b9-b661-7f2ef43e4f1b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:26.568060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-de23ced5-d78e-42b9-b661-7f2ef43e4f1b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1249 microversion: 2.1 time: 0.127492 Aug 24 05:47:26.568060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 185/372] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:26 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1249 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:27.590085 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-25ea35d4-b23d-4c84-9c9f-d7780f9d41e6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:27.591350 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-25ea35d4-b23d-4c84-9c9f-d7780f9d41e6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:27.599085 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25ea35d4-b23d-4c84-9c9f-d7780f9d41e6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:27.600615 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25ea35d4-b23d-4c84-9c9f-d7780f9d41e6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:27.601290 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25ea35d4-b23d-4c84-9c9f-d7780f9d41e6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:27.602390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25ea35d4-b23d-4c84-9c9f-d7780f9d41e6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:27.603193 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25ea35d4-b23d-4c84-9c9f-d7780f9d41e6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:27.603795 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25ea35d4-b23d-4c84-9c9f-d7780f9d41e6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:27.700516 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-25ea35d4-b23d-4c84-9c9f-d7780f9d41e6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:27.713873 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-25ea35d4-b23d-4c84-9c9f-d7780f9d41e6 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1249 microversion: 2.1 time: 0.128685 Aug 24 05:47:27.714858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 188/373] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:27 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1249 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:28.735703 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-57a5eff2-0889-4052-a8f7-ff01c6eb4fec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:28.736672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-57a5eff2-0889-4052-a8f7-ff01c6eb4fec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:28.744316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57a5eff2-0889-4052-a8f7-ff01c6eb4fec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:28.744884 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57a5eff2-0889-4052-a8f7-ff01c6eb4fec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:28.745408 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57a5eff2-0889-4052-a8f7-ff01c6eb4fec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:28.746281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57a5eff2-0889-4052-a8f7-ff01c6eb4fec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:28.746774 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57a5eff2-0889-4052-a8f7-ff01c6eb4fec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:28.747138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57a5eff2-0889-4052-a8f7-ff01c6eb4fec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:28.769152 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:28.821610 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-57a5eff2-0889-4052-a8f7-ff01c6eb4fec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:28.828447 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-57a5eff2-0889-4052-a8f7-ff01c6eb4fec tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1297 microversion: 2.1 time: 0.096712 Aug 24 05:47:28.829032 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 186/374] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:28 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:29.866107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5a142c40-0853-40c9-9faf-a93e51fbdead tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:29.867257 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5a142c40-0853-40c9-9faf-a93e51fbdead tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:29.884150 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a142c40-0853-40c9-9faf-a93e51fbdead tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:29.885782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a142c40-0853-40c9-9faf-a93e51fbdead tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:29.886882 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a142c40-0853-40c9-9faf-a93e51fbdead tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:29.893433 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a142c40-0853-40c9-9faf-a93e51fbdead tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:29.896243 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a142c40-0853-40c9-9faf-a93e51fbdead tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:29.897359 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5a142c40-0853-40c9-9faf-a93e51fbdead tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:29.998616 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5a142c40-0853-40c9-9faf-a93e51fbdead tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:30.010721 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5a142c40-0853-40c9-9faf-a93e51fbdead tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1315 microversion: 2.1 time: 0.152740 Aug 24 05:47:30.011967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 189/375] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:29 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:31.043600 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-98e34eed-57f9-4028-8547-ec249e5989ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:31.044248 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-98e34eed-57f9-4028-8547-ec249e5989ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:31.084595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98e34eed-57f9-4028-8547-ec249e5989ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:31.087169 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98e34eed-57f9-4028-8547-ec249e5989ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:31.088323 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98e34eed-57f9-4028-8547-ec249e5989ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:31.099175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98e34eed-57f9-4028-8547-ec249e5989ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:31.100060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98e34eed-57f9-4028-8547-ec249e5989ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:31.100907 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98e34eed-57f9-4028-8547-ec249e5989ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:31.603331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-98e34eed-57f9-4028-8547-ec249e5989ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:31.633758 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-98e34eed-57f9-4028-8547-ec249e5989ab tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.601722 Aug 24 05:47:31.636176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 187/376] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:31 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:32.663107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ce72c963-1c6e-488f-9884-e6030f2aeae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:32.663731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ce72c963-1c6e-488f-9884-e6030f2aeae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:32.673157 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce72c963-1c6e-488f-9884-e6030f2aeae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:32.674844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce72c963-1c6e-488f-9884-e6030f2aeae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:32.675311 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce72c963-1c6e-488f-9884-e6030f2aeae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:32.676287 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce72c963-1c6e-488f-9884-e6030f2aeae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:32.677002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce72c963-1c6e-488f-9884-e6030f2aeae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:32.677640 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce72c963-1c6e-488f-9884-e6030f2aeae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:32.899939 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:32.956902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ce72c963-1c6e-488f-9884-e6030f2aeae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:32.968860 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ce72c963-1c6e-488f-9884-e6030f2aeae5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.310564 Aug 24 05:47:32.972141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 190/377] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:32 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:33.625755 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-1510fe22-b4ca-41df-b0e4-16c91e2b034f req-66a12fb6-df1f-44e5-a555-20388f6d32af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64eb4995-d137-42b3-96b4-1af57d704189", "tag": "9f61d38a-f834-4c44-ba42-d2df9d160ab5"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:33.637685 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:33.659982 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-1510fe22-b4ca-41df-b0e4-16c91e2b034f req-66a12fb6-df1f-44e5-a555-20388f6d32af service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:33.660949 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-1510fe22-b4ca-41df-b0e4-16c91e2b034f req-66a12fb6-df1f-44e5-a555-20388f6d32af service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:33.661664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-1510fe22-b4ca-41df-b0e4-16c91e2b034f req-66a12fb6-df1f-44e5-a555-20388f6d32af service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:33.703431 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-1510fe22-b4ca-41df-b0e4-16c91e2b034f req-66a12fb6-df1f-44e5-a555-20388f6d32af service nova] Creating event network-changed:9f61d38a-f834-4c44-ba42-d2df9d160ab5 for instance 64eb4995-d137-42b3-96b4-1af57d704189 on hv-cinder-85426 Aug 24 05:47:33.717288 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-1510fe22-b4ca-41df-b0e4-16c91e2b034f req-66a12fb6-df1f-44e5-a555-20388f6d32af service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095178 Aug 24 05:47:33.718639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 188/378] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:47:34.001787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e7b075da-a000-45c2-9731-c14ed2d134dc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:34.003314 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e7b075da-a000-45c2-9731-c14ed2d134dc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:34.022295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e7b075da-a000-45c2-9731-c14ed2d134dc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:34.023226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e7b075da-a000-45c2-9731-c14ed2d134dc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:34.031126 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e7b075da-a000-45c2-9731-c14ed2d134dc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:34.045549 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e7b075da-a000-45c2-9731-c14ed2d134dc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:34.049326 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e7b075da-a000-45c2-9731-c14ed2d134dc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:34.050780 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e7b075da-a000-45c2-9731-c14ed2d134dc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:34.355162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e7b075da-a000-45c2-9731-c14ed2d134dc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:34.394108 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e7b075da-a000-45c2-9731-c14ed2d134dc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.395884 Aug 24 05:47:34.394716 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 191/379] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:33 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:35.412690 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=12 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:35.418138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-89dcad0a-400e-4bfc-9b88-99f4f4f6c62a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:35.420449 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-89dcad0a-400e-4bfc-9b88-99f4f4f6c62a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:35.427549 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89dcad0a-400e-4bfc-9b88-99f4f4f6c62a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:35.428096 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89dcad0a-400e-4bfc-9b88-99f4f4f6c62a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:35.428578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89dcad0a-400e-4bfc-9b88-99f4f4f6c62a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:35.429371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89dcad0a-400e-4bfc-9b88-99f4f4f6c62a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:35.429861 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89dcad0a-400e-4bfc-9b88-99f4f4f6c62a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:35.430488 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89dcad0a-400e-4bfc-9b88-99f4f4f6c62a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:35.589239 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-89dcad0a-400e-4bfc-9b88-99f4f4f6c62a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:35.599972 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-89dcad0a-400e-4bfc-9b88-99f4f4f6c62a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.187976 Aug 24 05:47:35.601132 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 189/380] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:35 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:36.629797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3970f6ea-b6d9-444d-ad6b-193f3da67f4a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:36.649045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3970f6ea-b6d9-444d-ad6b-193f3da67f4a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:36.664559 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3970f6ea-b6d9-444d-ad6b-193f3da67f4a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:36.675379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3970f6ea-b6d9-444d-ad6b-193f3da67f4a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:36.681056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3970f6ea-b6d9-444d-ad6b-193f3da67f4a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:36.682034 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3970f6ea-b6d9-444d-ad6b-193f3da67f4a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:36.682661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3970f6ea-b6d9-444d-ad6b-193f3da67f4a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:36.683509 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3970f6ea-b6d9-444d-ad6b-193f3da67f4a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:36.983926 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3970f6ea-b6d9-444d-ad6b-193f3da67f4a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:36.997525 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3970f6ea-b6d9-444d-ad6b-193f3da67f4a tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.372159 Aug 24 05:47:36.998114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 192/381] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:36 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:38.018468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8fec2758-1289-4513-afbb-2dff7b462dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:38.019145 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8fec2758-1289-4513-afbb-2dff7b462dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:38.038349 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8fec2758-1289-4513-afbb-2dff7b462dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:38.039535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8fec2758-1289-4513-afbb-2dff7b462dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:38.040216 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8fec2758-1289-4513-afbb-2dff7b462dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:38.041285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8fec2758-1289-4513-afbb-2dff7b462dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:38.041992 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8fec2758-1289-4513-afbb-2dff7b462dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:38.042918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8fec2758-1289-4513-afbb-2dff7b462dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:38.312200 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8fec2758-1289-4513-afbb-2dff7b462dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:38.326396 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8fec2758-1289-4513-afbb-2dff7b462dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.312049 Aug 24 05:47:38.328052 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 190/382] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:38 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:39.385980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6843c636-459e-4fba-87cc-71db4cc719ad tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:39.385980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6843c636-459e-4fba-87cc-71db4cc719ad tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:39.385980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6843c636-459e-4fba-87cc-71db4cc719ad tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:39.385980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6843c636-459e-4fba-87cc-71db4cc719ad tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:39.386710 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6843c636-459e-4fba-87cc-71db4cc719ad tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:39.386710 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6843c636-459e-4fba-87cc-71db4cc719ad tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:39.386710 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6843c636-459e-4fba-87cc-71db4cc719ad tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:39.386710 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6843c636-459e-4fba-87cc-71db4cc719ad tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:39.678267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6843c636-459e-4fba-87cc-71db4cc719ad tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:39.687596 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6843c636-459e-4fba-87cc-71db4cc719ad tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.336342 Aug 24 05:47:39.688539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 193/383] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:39 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:40.719259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-5d2465c2-dfb1-40d6-bc7c-9d747ab9964b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:40.720667 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5d2465c2-dfb1-40d6-bc7c-9d747ab9964b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:40.742324 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d2465c2-dfb1-40d6-bc7c-9d747ab9964b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:40.746267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d2465c2-dfb1-40d6-bc7c-9d747ab9964b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:40.746267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d2465c2-dfb1-40d6-bc7c-9d747ab9964b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:40.746267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d2465c2-dfb1-40d6-bc7c-9d747ab9964b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:40.746267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d2465c2-dfb1-40d6-bc7c-9d747ab9964b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:40.747595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d2465c2-dfb1-40d6-bc7c-9d747ab9964b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:41.094004 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5d2465c2-dfb1-40d6-bc7c-9d747ab9964b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:41.106740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-5d2465c2-dfb1-40d6-bc7c-9d747ab9964b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.391341 Aug 24 05:47:41.131312 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 191/384] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:40 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:42.157221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1f725cab-85cb-4bee-aca2-2882d0e6abbc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:42.168558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1f725cab-85cb-4bee-aca2-2882d0e6abbc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:42.228062 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f725cab-85cb-4bee-aca2-2882d0e6abbc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:42.230165 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f725cab-85cb-4bee-aca2-2882d0e6abbc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:42.231972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f725cab-85cb-4bee-aca2-2882d0e6abbc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:42.234356 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f725cab-85cb-4bee-aca2-2882d0e6abbc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:42.235021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f725cab-85cb-4bee-aca2-2882d0e6abbc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:42.235650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f725cab-85cb-4bee-aca2-2882d0e6abbc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:42.493649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1f725cab-85cb-4bee-aca2-2882d0e6abbc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:42.503329 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1f725cab-85cb-4bee-aca2-2882d0e6abbc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.367743 Aug 24 05:47:42.505647 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 194/385] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:42 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:43.530294 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9ab26799-d076-4f47-8f8e-eb6779f7aaa9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:43.544747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9ab26799-d076-4f47-8f8e-eb6779f7aaa9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:43.544747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ab26799-d076-4f47-8f8e-eb6779f7aaa9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:43.544747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ab26799-d076-4f47-8f8e-eb6779f7aaa9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:43.544747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ab26799-d076-4f47-8f8e-eb6779f7aaa9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:43.545146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ab26799-d076-4f47-8f8e-eb6779f7aaa9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:43.545146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ab26799-d076-4f47-8f8e-eb6779f7aaa9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:43.545146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ab26799-d076-4f47-8f8e-eb6779f7aaa9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:43.738458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9ab26799-d076-4f47-8f8e-eb6779f7aaa9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:43.750314 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9ab26799-d076-4f47-8f8e-eb6779f7aaa9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.224306 Aug 24 05:47:43.751115 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 192/386] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:43 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:44.777437 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-545e8b98-8771-4273-9124-36b0b3a086a5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:44.778650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-545e8b98-8771-4273-9124-36b0b3a086a5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:44.784503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=34 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:44.795018 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-545e8b98-8771-4273-9124-36b0b3a086a5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:44.796123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-545e8b98-8771-4273-9124-36b0b3a086a5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:44.797064 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-545e8b98-8771-4273-9124-36b0b3a086a5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:44.798565 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-545e8b98-8771-4273-9124-36b0b3a086a5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:44.799612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-545e8b98-8771-4273-9124-36b0b3a086a5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:44.800947 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-545e8b98-8771-4273-9124-36b0b3a086a5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:45.032117 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-545e8b98-8771-4273-9124-36b0b3a086a5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:45.055754 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-545e8b98-8771-4273-9124-36b0b3a086a5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.286487 Aug 24 05:47:45.068474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 195/387] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:44 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:45.945377 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-880c5aa0-8ed2-4cd1-8aef-3ea65330d272 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Action: 'create', calling method: .version_select at 0x7f065cc5c790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-107995616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS8wAz8xDayFqeLXB5X2D1BOmD3HezBLV1JBHylmB9rWmt1g3+izR6d3CCVpUg9dOBzy1hiP6kUlEcmFtZx2qnMr76jT3WIcjyho2Kv6bpL+8AMoTfHi7KqY936a6IE2g=="}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:45.972663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-880c5aa0-8ed2-4cd1-8aef-3ea65330d272 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Getting quotas for project de8b104cdda04729a55a5af9d4503c81. Resources: {'key_pairs'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:47:45.980000 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-880c5aa0-8ed2-4cd1-8aef-3ea65330d272 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Getting quotas for user 358428458beb4ad6820c6d40d39390e4 and project de8b104cdda04729a55a5af9d4503c81. Resources: {'key_pairs'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:47:46.088920 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-126b3cbe-5450-4883-bc8b-028275463bb3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:46.089915 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-126b3cbe-5450-4883-bc8b-028275463bb3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:46.098658 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-126b3cbe-5450-4883-bc8b-028275463bb3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:46.099151 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-126b3cbe-5450-4883-bc8b-028275463bb3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:46.099597 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-126b3cbe-5450-4883-bc8b-028275463bb3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:46.100356 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-126b3cbe-5450-4883-bc8b-028275463bb3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:46.100849 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-126b3cbe-5450-4883-bc8b-028275463bb3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:46.101277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-126b3cbe-5450-4883-bc8b-028275463bb3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:46.112489 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-880c5aa0-8ed2-4cd1-8aef-3ea65330d272 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.169725 Aug 24 05:47:46.123694 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 193/388] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 24 05:47:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:46.188538 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-343896553", "imageRef": "1ef3c0b1-3bd9-4ea1-a809-c9a0fc6281b5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-107995616", "networks": [{"uuid": "ef556570-4025-46a9-b886-967722b91b07"}]}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:46.246054 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] validate_networks() for [('ef556570-4025-46a9-b886-967722b91b07', None, None, None, None, None)] {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:47:46.310352 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-126b3cbe-5450-4883-bc8b-028275463bb3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:46.319972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-126b3cbe-5450-4883-bc8b-028275463bb3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.240076 Aug 24 05:47:46.321144 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 196/389] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:46 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:46.711726 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:47:46.713233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:47:46.714082 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:47:46.714276 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:47:46.714985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:47:46.726700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:46.727476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:46.727683 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:46.728457 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:46.728966 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:46.729472 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:46.749774 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Getting quotas for project de8b104cdda04729a55a5af9d4503c81. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:47:46.755671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Getting quotas for user 358428458beb4ad6820c6d40d39390e4 and project de8b104cdda04729a55a5af9d4503c81. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:47:46.784969 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:47:46.788285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1ef3c0b1-3bd9-4ea1-a809-c9a0fc6281b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:47:47.008797 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7b27c172-ff8f-4098-b34b-6fda53fe9ee5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827000 Aug 24 05:47:47.010462 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 194/390] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:47:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:47:47.031086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9c200056-5946-4c6a-8ed4-88d5192147d6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:47.032687 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9c200056-5946-4c6a-8ed4-88d5192147d6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:47.120444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9c200056-5946-4c6a-8ed4-88d5192147d6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:47.133103 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9c200056-5946-4c6a-8ed4-88d5192147d6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1257 microversion: 2.1 time: 0.110871 Aug 24 05:47:47.134022 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 197/391] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:47 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1257 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:47.342201 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2257f2ea-5c3a-4d39-ad33-a0e7cb21b2a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:47.343119 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2257f2ea-5c3a-4d39-ad33-a0e7cb21b2a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:47.362575 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2257f2ea-5c3a-4d39-ad33-a0e7cb21b2a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:47.367964 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2257f2ea-5c3a-4d39-ad33-a0e7cb21b2a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:47.369238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2257f2ea-5c3a-4d39-ad33-a0e7cb21b2a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:47.373528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2257f2ea-5c3a-4d39-ad33-a0e7cb21b2a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:47.377112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2257f2ea-5c3a-4d39-ad33-a0e7cb21b2a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:47.378791 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2257f2ea-5c3a-4d39-ad33-a0e7cb21b2a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:47.557618 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2257f2ea-5c3a-4d39-ad33-a0e7cb21b2a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:47.567914 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2257f2ea-5c3a-4d39-ad33-a0e7cb21b2a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.230423 Aug 24 05:47:47.568907 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 195/392] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:47 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:48.170789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-49b3a082-a9a4-49ea-aec6-9b1db4a36d16 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:48.171382 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-49b3a082-a9a4-49ea-aec6-9b1db4a36d16 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:48.249307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-49b3a082-a9a4-49ea-aec6-9b1db4a36d16 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:48.258230 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-49b3a082-a9a4-49ea-aec6-9b1db4a36d16 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1257 microversion: 2.1 time: 0.091544 Aug 24 05:47:48.258872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 198/393] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:48 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1257 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:48.590330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d461f6d5-98d1-4876-99e6-9c16f00cb7e7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:48.590883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d461f6d5-98d1-4876-99e6-9c16f00cb7e7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:48.592837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:48.597753 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d461f6d5-98d1-4876-99e6-9c16f00cb7e7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:48.602906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d461f6d5-98d1-4876-99e6-9c16f00cb7e7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:48.602906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d461f6d5-98d1-4876-99e6-9c16f00cb7e7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:48.602906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d461f6d5-98d1-4876-99e6-9c16f00cb7e7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:48.602906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d461f6d5-98d1-4876-99e6-9c16f00cb7e7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:48.603313 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d461f6d5-98d1-4876-99e6-9c16f00cb7e7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:48.740929 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d461f6d5-98d1-4876-99e6-9c16f00cb7e7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:48.749883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d461f6d5-98d1-4876-99e6-9c16f00cb7e7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.163510 Aug 24 05:47:48.750470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 196/394] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:48 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:49.295448 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-063cd615-6472-4bbd-8e77-acaa36aeb077 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:49.296358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-063cd615-6472-4bbd-8e77-acaa36aeb077 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:49.304335 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-063cd615-6472-4bbd-8e77-acaa36aeb077 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:49.305190 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-063cd615-6472-4bbd-8e77-acaa36aeb077 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:49.305836 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-063cd615-6472-4bbd-8e77-acaa36aeb077 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:49.306621 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-063cd615-6472-4bbd-8e77-acaa36aeb077 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:49.307262 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-063cd615-6472-4bbd-8e77-acaa36aeb077 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:49.307877 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-063cd615-6472-4bbd-8e77-acaa36aeb077 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:49.397300 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-063cd615-6472-4bbd-8e77-acaa36aeb077 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:49.406008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-063cd615-6472-4bbd-8e77-acaa36aeb077 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1261 microversion: 2.1 time: 0.116406 Aug 24 05:47:49.406865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 199/395] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:49 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1261 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:49.772083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-58ac01c9-de02-40ed-bcfb-0281ae889fb7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:49.773515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-58ac01c9-de02-40ed-bcfb-0281ae889fb7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:49.780904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-58ac01c9-de02-40ed-bcfb-0281ae889fb7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:49.781421 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-58ac01c9-de02-40ed-bcfb-0281ae889fb7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:49.781880 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-58ac01c9-de02-40ed-bcfb-0281ae889fb7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:49.782657 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-58ac01c9-de02-40ed-bcfb-0281ae889fb7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:49.783535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-58ac01c9-de02-40ed-bcfb-0281ae889fb7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:49.784167 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-58ac01c9-de02-40ed-bcfb-0281ae889fb7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:49.964163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-58ac01c9-de02-40ed-bcfb-0281ae889fb7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:49.975709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-58ac01c9-de02-40ed-bcfb-0281ae889fb7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.208309 Aug 24 05:47:49.976506 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 197/396] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:49 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:50.436562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ffdf75b9-2b2c-42b7-bdb2-c37c2d9b0290 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:50.437340 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ffdf75b9-2b2c-42b7-bdb2-c37c2d9b0290 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:50.446004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ffdf75b9-2b2c-42b7-bdb2-c37c2d9b0290 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:50.447040 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ffdf75b9-2b2c-42b7-bdb2-c37c2d9b0290 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:50.448006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ffdf75b9-2b2c-42b7-bdb2-c37c2d9b0290 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:50.448760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ffdf75b9-2b2c-42b7-bdb2-c37c2d9b0290 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:50.449228 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ffdf75b9-2b2c-42b7-bdb2-c37c2d9b0290 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:50.449650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ffdf75b9-2b2c-42b7-bdb2-c37c2d9b0290 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:50.548026 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ffdf75b9-2b2c-42b7-bdb2-c37c2d9b0290 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:50.559333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ffdf75b9-2b2c-42b7-bdb2-c37c2d9b0290 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1261 microversion: 2.1 time: 0.130418 Aug 24 05:47:50.564485 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 200/397] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:50 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1261 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:50.997593 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e0eaea60-19e1-41b2-bf19-27d71b5f90c7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:50.998201 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e0eaea60-19e1-41b2-bf19-27d71b5f90c7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:51.005826 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0eaea60-19e1-41b2-bf19-27d71b5f90c7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:51.006319 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0eaea60-19e1-41b2-bf19-27d71b5f90c7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:51.010111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0eaea60-19e1-41b2-bf19-27d71b5f90c7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:51.010111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0eaea60-19e1-41b2-bf19-27d71b5f90c7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:51.010111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0eaea60-19e1-41b2-bf19-27d71b5f90c7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:51.010111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0eaea60-19e1-41b2-bf19-27d71b5f90c7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:51.180954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e0eaea60-19e1-41b2-bf19-27d71b5f90c7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:51.195613 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e0eaea60-19e1-41b2-bf19-27d71b5f90c7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.202054 Aug 24 05:47:51.196197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 198/398] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:50 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:51.589607 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-447145a3-e6f6-440d-81c0-c5dfd0355e9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:51.592646 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-447145a3-e6f6-440d-81c0-c5dfd0355e9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:51.604958 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-447145a3-e6f6-440d-81c0-c5dfd0355e9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:51.605442 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-447145a3-e6f6-440d-81c0-c5dfd0355e9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:51.607990 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-447145a3-e6f6-440d-81c0-c5dfd0355e9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:51.609033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-447145a3-e6f6-440d-81c0-c5dfd0355e9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:51.609460 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-447145a3-e6f6-440d-81c0-c5dfd0355e9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:51.609895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-447145a3-e6f6-440d-81c0-c5dfd0355e9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:51.697261 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-447145a3-e6f6-440d-81c0-c5dfd0355e9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:51.709062 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-447145a3-e6f6-440d-81c0-c5dfd0355e9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1261 microversion: 2.1 time: 0.130514 Aug 24 05:47:51.710644 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 201/399] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:51 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1261 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:52.223934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-51f964d2-7946-4515-86bf-13db8977a2ba tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:52.225702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-51f964d2-7946-4515-86bf-13db8977a2ba tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:52.234004 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-51f964d2-7946-4515-86bf-13db8977a2ba tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:52.234928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-51f964d2-7946-4515-86bf-13db8977a2ba tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:52.234928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-51f964d2-7946-4515-86bf-13db8977a2ba tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:52.235650 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-51f964d2-7946-4515-86bf-13db8977a2ba tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:52.237003 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-51f964d2-7946-4515-86bf-13db8977a2ba tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:52.241333 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-51f964d2-7946-4515-86bf-13db8977a2ba tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:52.383455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-51f964d2-7946-4515-86bf-13db8977a2ba tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:52.391723 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-51f964d2-7946-4515-86bf-13db8977a2ba tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.176175 Aug 24 05:47:52.392615 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 199/400] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:52 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:52.738160 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-929bcdbd-6237-4bc7-9a1c-9eb4710f35af tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:52.740439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-929bcdbd-6237-4bc7-9a1c-9eb4710f35af tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:52.750522 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-929bcdbd-6237-4bc7-9a1c-9eb4710f35af tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:52.751624 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-929bcdbd-6237-4bc7-9a1c-9eb4710f35af tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:52.752362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-929bcdbd-6237-4bc7-9a1c-9eb4710f35af tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:52.753662 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-929bcdbd-6237-4bc7-9a1c-9eb4710f35af tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:52.754745 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-929bcdbd-6237-4bc7-9a1c-9eb4710f35af tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:52.755611 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-929bcdbd-6237-4bc7-9a1c-9eb4710f35af tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:52.847833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-929bcdbd-6237-4bc7-9a1c-9eb4710f35af tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:52.862976 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-929bcdbd-6237-4bc7-9a1c-9eb4710f35af tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1309 microversion: 2.1 time: 0.127088 Aug 24 05:47:52.865244 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 202/401] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:52 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1309 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:53.415680 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c52478ee-0a94-48b1-b00e-d5da7ebce293 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:53.416300 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c52478ee-0a94-48b1-b00e-d5da7ebce293 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:53.422893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c52478ee-0a94-48b1-b00e-d5da7ebce293 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:53.424100 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c52478ee-0a94-48b1-b00e-d5da7ebce293 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:53.424955 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c52478ee-0a94-48b1-b00e-d5da7ebce293 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:53.425688 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c52478ee-0a94-48b1-b00e-d5da7ebce293 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:53.426154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c52478ee-0a94-48b1-b00e-d5da7ebce293 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:53.426585 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c52478ee-0a94-48b1-b00e-d5da7ebce293 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:53.594727 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c52478ee-0a94-48b1-b00e-d5da7ebce293 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:53.604837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c52478ee-0a94-48b1-b00e-d5da7ebce293 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.193185 Aug 24 05:47:53.605351 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 200/402] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:53 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:53.889423 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-98024e22-2854-4eba-a8fa-5f583146b3b8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:53.890564 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-98024e22-2854-4eba-a8fa-5f583146b3b8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:53.898021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98024e22-2854-4eba-a8fa-5f583146b3b8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:53.898543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98024e22-2854-4eba-a8fa-5f583146b3b8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:53.900889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98024e22-2854-4eba-a8fa-5f583146b3b8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:53.900889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98024e22-2854-4eba-a8fa-5f583146b3b8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:53.900889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98024e22-2854-4eba-a8fa-5f583146b3b8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:53.900889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98024e22-2854-4eba-a8fa-5f583146b3b8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:54.214633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-98024e22-2854-4eba-a8fa-5f583146b3b8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:54.229337 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-98024e22-2854-4eba-a8fa-5f583146b3b8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.344041 Aug 24 05:47:54.230423 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 203/403] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:53 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:54.501594 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-1586c993-6035-4f08-b396-2804e08c8f29 req-427f877f-2da5-43be-a326-0cda5ad257d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64eb4995-d137-42b3-96b4-1af57d704189", "name": "network-vif-plugged", "status": "completed", "tag": "9f61d38a-f834-4c44-ba42-d2df9d160ab5"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:54.530958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-1586c993-6035-4f08-b396-2804e08c8f29 req-427f877f-2da5-43be-a326-0cda5ad257d1 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:54.533700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-1586c993-6035-4f08-b396-2804e08c8f29 req-427f877f-2da5-43be-a326-0cda5ad257d1 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:54.535977 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-1586c993-6035-4f08-b396-2804e08c8f29 req-427f877f-2da5-43be-a326-0cda5ad257d1 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:54.561732 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-1586c993-6035-4f08-b396-2804e08c8f29 req-427f877f-2da5-43be-a326-0cda5ad257d1 service nova] Creating event network-vif-plugged:9f61d38a-f834-4c44-ba42-d2df9d160ab5 for instance 64eb4995-d137-42b3-96b4-1af57d704189 on hv-cinder-85426 Aug 24 05:47:54.571904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-1586c993-6035-4f08-b396-2804e08c8f29 req-427f877f-2da5-43be-a326-0cda5ad257d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075417 Aug 24 05:47:54.576756 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 201/404] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:54.630592 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-16c1aef1-382e-4dbf-9a02-354323e5786d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:54.631637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-16c1aef1-382e-4dbf-9a02-354323e5786d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:54.644543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16c1aef1-382e-4dbf-9a02-354323e5786d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:54.646847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16c1aef1-382e-4dbf-9a02-354323e5786d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:54.648433 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16c1aef1-382e-4dbf-9a02-354323e5786d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:54.650296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16c1aef1-382e-4dbf-9a02-354323e5786d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:54.653114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16c1aef1-382e-4dbf-9a02-354323e5786d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:54.653862 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16c1aef1-382e-4dbf-9a02-354323e5786d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:54.913757 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-16c1aef1-382e-4dbf-9a02-354323e5786d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:54.922307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:54.927166 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-16c1aef1-382e-4dbf-9a02-354323e5786d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.303558 Aug 24 05:47:54.928079 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 204/405] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:54 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:55.252279 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4fe95dbf-2756-4363-8623-203507e1a36d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:55.253870 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4fe95dbf-2756-4363-8623-203507e1a36d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:55.262359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fe95dbf-2756-4363-8623-203507e1a36d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:55.263930 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fe95dbf-2756-4363-8623-203507e1a36d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:55.264634 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fe95dbf-2756-4363-8623-203507e1a36d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:55.266466 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fe95dbf-2756-4363-8623-203507e1a36d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:55.268118 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fe95dbf-2756-4363-8623-203507e1a36d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:55.268643 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fe95dbf-2756-4363-8623-203507e1a36d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:55.484000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-b80b9b78-2ccc-460d-bb88-be929f869ea6 req-9e872274-8543-4bb6-aad6-8fab67cdd389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be90cc32-6bea-4a9f-99b6-c47cdbeea246", "tag": "5aeffe0a-e1d3-441b-86b9-7b72a10a2baa"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:55.523417 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b80b9b78-2ccc-460d-bb88-be929f869ea6 req-9e872274-8543-4bb6-aad6-8fab67cdd389 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:55.525319 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b80b9b78-2ccc-460d-bb88-be929f869ea6 req-9e872274-8543-4bb6-aad6-8fab67cdd389 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:55.529586 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b80b9b78-2ccc-460d-bb88-be929f869ea6 req-9e872274-8543-4bb6-aad6-8fab67cdd389 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:55.559492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4fe95dbf-2756-4363-8623-203507e1a36d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:55.585232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-b80b9b78-2ccc-460d-bb88-be929f869ea6 req-9e872274-8543-4bb6-aad6-8fab67cdd389 service nova] Creating event network-changed:5aeffe0a-e1d3-441b-86b9-7b72a10a2baa for instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 on hv-cinder-85426 Aug 24 05:47:55.588658 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4fe95dbf-2756-4363-8623-203507e1a36d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.340213 Aug 24 05:47:55.589372 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 202/406] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:55 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:55.612654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-b80b9b78-2ccc-460d-bb88-be929f869ea6 req-9e872274-8543-4bb6-aad6-8fab67cdd389 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138614 Aug 24 05:47:55.613285 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 205/407] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:55.953032 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-aa7b1e43-2c49-4158-8d5a-486c69502a6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:55.953866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-aa7b1e43-2c49-4158-8d5a-486c69502a6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:55.964252 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa7b1e43-2c49-4158-8d5a-486c69502a6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:55.966194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa7b1e43-2c49-4158-8d5a-486c69502a6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:55.967499 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa7b1e43-2c49-4158-8d5a-486c69502a6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:55.969178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa7b1e43-2c49-4158-8d5a-486c69502a6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:55.970536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa7b1e43-2c49-4158-8d5a-486c69502a6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:55.971845 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa7b1e43-2c49-4158-8d5a-486c69502a6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:56.157716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-aa7b1e43-2c49-4158-8d5a-486c69502a6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:56.194011 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-aa7b1e43-2c49-4158-8d5a-486c69502a6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.245979 Aug 24 05:47:56.195134 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 203/408] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:55 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:56.614919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-39cf0141-454a-434a-8b65-650163ca9360 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:56.615994 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-39cf0141-454a-434a-8b65-650163ca9360 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:56.622829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-39cf0141-454a-434a-8b65-650163ca9360 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:56.623453 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-39cf0141-454a-434a-8b65-650163ca9360 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:56.623948 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-39cf0141-454a-434a-8b65-650163ca9360 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:56.624883 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-39cf0141-454a-434a-8b65-650163ca9360 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:56.625609 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-39cf0141-454a-434a-8b65-650163ca9360 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:56.626038 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-39cf0141-454a-434a-8b65-650163ca9360 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:56.812273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-39cf0141-454a-434a-8b65-650163ca9360 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:56.826596 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-39cf0141-454a-434a-8b65-650163ca9360 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.217036 Aug 24 05:47:56.827363 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 206/409] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:56 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:57.217590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a7acc976-0c6e-413d-94fb-fda5f7ac22ee tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:57.220713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a7acc976-0c6e-413d-94fb-fda5f7ac22ee tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:57.223096 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:57.225343 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=10 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:57.237597 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7acc976-0c6e-413d-94fb-fda5f7ac22ee tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:57.238152 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7acc976-0c6e-413d-94fb-fda5f7ac22ee tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:57.238580 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7acc976-0c6e-413d-94fb-fda5f7ac22ee tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:57.239590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7acc976-0c6e-413d-94fb-fda5f7ac22ee tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:57.240154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7acc976-0c6e-413d-94fb-fda5f7ac22ee tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:57.240801 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7acc976-0c6e-413d-94fb-fda5f7ac22ee tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:57.398600 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a7acc976-0c6e-413d-94fb-fda5f7ac22ee tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:57.406758 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a7acc976-0c6e-413d-94fb-fda5f7ac22ee tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.194673 Aug 24 05:47:57.407360 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 204/410] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:57 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:57.848462 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-dd52a131-7188-424f-99f3-af991a9307a5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:57.849331 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-dd52a131-7188-424f-99f3-af991a9307a5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:57.856433 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd52a131-7188-424f-99f3-af991a9307a5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:57.857025 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd52a131-7188-424f-99f3-af991a9307a5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:57.857542 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd52a131-7188-424f-99f3-af991a9307a5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:57.858315 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd52a131-7188-424f-99f3-af991a9307a5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:57.858963 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd52a131-7188-424f-99f3-af991a9307a5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:57.859390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd52a131-7188-424f-99f3-af991a9307a5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:58.023825 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dd52a131-7188-424f-99f3-af991a9307a5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:58.032048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-dd52a131-7188-424f-99f3-af991a9307a5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.187695 Aug 24 05:47:58.033355 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 207/411] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:57 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:58.430765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-47e0ceb7-824c-4876-9f70-78f5bd777e1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:58.432668 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-47e0ceb7-824c-4876-9f70-78f5bd777e1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:58.439898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47e0ceb7-824c-4876-9f70-78f5bd777e1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:58.440318 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47e0ceb7-824c-4876-9f70-78f5bd777e1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:58.440780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47e0ceb7-824c-4876-9f70-78f5bd777e1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:58.441531 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47e0ceb7-824c-4876-9f70-78f5bd777e1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:58.441948 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47e0ceb7-824c-4876-9f70-78f5bd777e1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:58.442386 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47e0ceb7-824c-4876-9f70-78f5bd777e1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:58.600739 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-47e0ceb7-824c-4876-9f70-78f5bd777e1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:58.611748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-47e0ceb7-824c-4876-9f70-78f5bd777e1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.185398 Aug 24 05:47:58.617573 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 205/412] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:58 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:59.055042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0df8e234-0879-4453-a76d-bae53e154d2f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:59.055897 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0df8e234-0879-4453-a76d-bae53e154d2f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:59.058371 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=4 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:59.064842 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0df8e234-0879-4453-a76d-bae53e154d2f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:59.065451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0df8e234-0879-4453-a76d-bae53e154d2f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:59.065956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0df8e234-0879-4453-a76d-bae53e154d2f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:59.066951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0df8e234-0879-4453-a76d-bae53e154d2f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:59.067497 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0df8e234-0879-4453-a76d-bae53e154d2f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:59.068005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0df8e234-0879-4453-a76d-bae53e154d2f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:59.247499 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-557577147", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:59.247830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0df8e234-0879-4453-a76d-bae53e154d2f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:59.253291 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0df8e234-0879-4453-a76d-bae53e154d2f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.202021 Aug 24 05:47:59.254032 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 208/413] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:59 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:59.304586 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] validate_networks() for None {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:47:59.633563 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:47:59.634224 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:47:59.634765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:47:59.635496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:47:59.636141 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:47:59.640000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ed254617-f989-4834-84b7-68152eab1c7c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:59.643094 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ed254617-f989-4834-84b7-68152eab1c7c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:59.649900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:59.649900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:59.649900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:59.649900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:59.650457 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:59.650457 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:59.660851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:59.661272 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed254617-f989-4834-84b7-68152eab1c7c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:59.661780 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed254617-f989-4834-84b7-68152eab1c7c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:59.662221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed254617-f989-4834-84b7-68152eab1c7c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:59.662942 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed254617-f989-4834-84b7-68152eab1c7c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:59.663402 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed254617-f989-4834-84b7-68152eab1c7c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:59.663908 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ed254617-f989-4834-84b7-68152eab1c7c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:59.673322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Getting quotas for project 53e1b207a1e9479e88e00371843f7ddd. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:47:59.678387 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Getting quotas for user 26bdb5e1c6d145e8a8c6792b2534a836 and project 53e1b207a1e9479e88e00371843f7ddd. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:47:59.691060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:47:59.693570 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:47:59.847404 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d537e710-aa8d-46e7-a3b2-b1812494145f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614021 Aug 24 05:47:59.848356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 206/414] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:47:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:47:59.861293 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-43a75e40-22f1-4664-8827-708800032786 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:59.862660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-43a75e40-22f1-4664-8827-708800032786 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:00.195394 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-43a75e40-22f1-4664-8827-708800032786 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:00.217064 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-43a75e40-22f1-4664-8827-708800032786 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1214 microversion: 2.1 time: 0.361283 Aug 24 05:48:00.225841 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 207/415] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:59 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1214 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:00.272288 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ed254617-f989-4834-84b7-68152eab1c7c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:00.291608 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b2ceb14f-f29e-4b98-87c6-ac32171b92be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:00.291608 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b2ceb14f-f29e-4b98-87c6-ac32171b92be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:00.297738 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2ceb14f-f29e-4b98-87c6-ac32171b92be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:00.299662 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ed254617-f989-4834-84b7-68152eab1c7c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.668599 Aug 24 05:48:00.299826 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2ceb14f-f29e-4b98-87c6-ac32171b92be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:00.300296 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2ceb14f-f29e-4b98-87c6-ac32171b92be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:00.301047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2ceb14f-f29e-4b98-87c6-ac32171b92be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:00.311175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2ceb14f-f29e-4b98-87c6-ac32171b92be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:00.311759 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2ceb14f-f29e-4b98-87c6-ac32171b92be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:00.316057 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 209/416] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:59 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:00.710019 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b2ceb14f-f29e-4b98-87c6-ac32171b92be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:00.720462 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b2ceb14f-f29e-4b98-87c6-ac32171b92be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.444337 Aug 24 05:48:00.733254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 208/417] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:00 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:01.242318 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9691d99b-f24e-4834-bd4b-a015abb4934a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:01.254078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9691d99b-f24e-4834-bd4b-a015abb4934a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:01.301581 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9691d99b-f24e-4834-bd4b-a015abb4934a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:01.309585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9691d99b-f24e-4834-bd4b-a015abb4934a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1214 microversion: 2.1 time: 0.071959 Aug 24 05:48:01.310395 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 210/418] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:01 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:01.328649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-743df735-1937-44cc-a034-ed3aac33a50d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:01.328649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-743df735-1937-44cc-a034-ed3aac33a50d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:01.330973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-743df735-1937-44cc-a034-ed3aac33a50d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:01.331455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-743df735-1937-44cc-a034-ed3aac33a50d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:01.331886 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-743df735-1937-44cc-a034-ed3aac33a50d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:01.332610 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-743df735-1937-44cc-a034-ed3aac33a50d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:01.333049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-743df735-1937-44cc-a034-ed3aac33a50d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:01.333474 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-743df735-1937-44cc-a034-ed3aac33a50d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:01.477657 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-743df735-1937-44cc-a034-ed3aac33a50d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:01.491055 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-743df735-1937-44cc-a034-ed3aac33a50d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.171396 Aug 24 05:48:01.492689 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 209/419] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:01 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:01.745389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b6ed4464-fe66-42d0-90c0-e6272afdb2f6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:01.746418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b6ed4464-fe66-42d0-90c0-e6272afdb2f6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:01.756812 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6ed4464-fe66-42d0-90c0-e6272afdb2f6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:01.757606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6ed4464-fe66-42d0-90c0-e6272afdb2f6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:01.758079 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6ed4464-fe66-42d0-90c0-e6272afdb2f6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:01.759008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6ed4464-fe66-42d0-90c0-e6272afdb2f6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:01.759469 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6ed4464-fe66-42d0-90c0-e6272afdb2f6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:01.759901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6ed4464-fe66-42d0-90c0-e6272afdb2f6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:01.946427 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b6ed4464-fe66-42d0-90c0-e6272afdb2f6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:01.956961 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b6ed4464-fe66-42d0-90c0-e6272afdb2f6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.215742 Aug 24 05:48:01.972113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 211/420] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:01 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:02.332449 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3f85c471-7360-4bf9-9cbe-edef2c873886 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:02.333064 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3f85c471-7360-4bf9-9cbe-edef2c873886 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:02.341722 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f85c471-7360-4bf9-9cbe-edef2c873886 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:02.342230 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f85c471-7360-4bf9-9cbe-edef2c873886 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:02.342667 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f85c471-7360-4bf9-9cbe-edef2c873886 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:02.343368 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f85c471-7360-4bf9-9cbe-edef2c873886 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:02.344679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f85c471-7360-4bf9-9cbe-edef2c873886 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:02.345838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3f85c471-7360-4bf9-9cbe-edef2c873886 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:02.427540 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3f85c471-7360-4bf9-9cbe-edef2c873886 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:02.440877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3f85c471-7360-4bf9-9cbe-edef2c873886 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1218 microversion: 2.1 time: 0.112861 Aug 24 05:48:02.442200 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 210/421] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:02 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:02.516417 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-07ed444f-f71c-4b6c-a266-8a56f9c91d71 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:02.518448 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-07ed444f-f71c-4b6c-a266-8a56f9c91d71 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:02.526039 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-07ed444f-f71c-4b6c-a266-8a56f9c91d71 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:02.526846 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-07ed444f-f71c-4b6c-a266-8a56f9c91d71 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:02.527574 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-07ed444f-f71c-4b6c-a266-8a56f9c91d71 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:02.528749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-07ed444f-f71c-4b6c-a266-8a56f9c91d71 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:02.529468 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-07ed444f-f71c-4b6c-a266-8a56f9c91d71 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:02.530100 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-07ed444f-f71c-4b6c-a266-8a56f9c91d71 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:02.749259 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-07ed444f-f71c-4b6c-a266-8a56f9c91d71 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:02.759724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-07ed444f-f71c-4b6c-a266-8a56f9c91d71 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.248612 Aug 24 05:48:02.773763 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 212/422] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:02 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:02.979657 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a7cf32cf-252b-4b0d-9b0b-85b6f0442b08 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:02.980991 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a7cf32cf-252b-4b0d-9b0b-85b6f0442b08 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:02.993903 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7cf32cf-252b-4b0d-9b0b-85b6f0442b08 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:02.995919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7cf32cf-252b-4b0d-9b0b-85b6f0442b08 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:02.995919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7cf32cf-252b-4b0d-9b0b-85b6f0442b08 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:02.996437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7cf32cf-252b-4b0d-9b0b-85b6f0442b08 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:02.997059 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7cf32cf-252b-4b0d-9b0b-85b6f0442b08 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:02.997638 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a7cf32cf-252b-4b0d-9b0b-85b6f0442b08 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:03.221111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a7cf32cf-252b-4b0d-9b0b-85b6f0442b08 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:03.233488 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a7cf32cf-252b-4b0d-9b0b-85b6f0442b08 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.258048 Aug 24 05:48:03.234133 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 211/423] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:02 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:03.465663 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5c3a56e6-30b6-437b-a21f-153ddd279878 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:03.466482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5c3a56e6-30b6-437b-a21f-153ddd279878 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:03.474314 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c3a56e6-30b6-437b-a21f-153ddd279878 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:03.474801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c3a56e6-30b6-437b-a21f-153ddd279878 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:03.475260 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c3a56e6-30b6-437b-a21f-153ddd279878 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:03.476157 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c3a56e6-30b6-437b-a21f-153ddd279878 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:03.476690 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c3a56e6-30b6-437b-a21f-153ddd279878 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:03.482774 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c3a56e6-30b6-437b-a21f-153ddd279878 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:03.581128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5c3a56e6-30b6-437b-a21f-153ddd279878 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:03.586393 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5c3a56e6-30b6-437b-a21f-153ddd279878 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1218 microversion: 2.1 time: 0.124611 Aug 24 05:48:03.587065 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 213/424] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:03 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:03.783386 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2eb05dcc-802c-487c-aaac-3bcde98aeaca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:03.786881 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2eb05dcc-802c-487c-aaac-3bcde98aeaca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:03.790597 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2eb05dcc-802c-487c-aaac-3bcde98aeaca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:03.791696 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2eb05dcc-802c-487c-aaac-3bcde98aeaca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:03.792215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2eb05dcc-802c-487c-aaac-3bcde98aeaca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:03.793591 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2eb05dcc-802c-487c-aaac-3bcde98aeaca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:03.794315 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2eb05dcc-802c-487c-aaac-3bcde98aeaca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:03.794841 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2eb05dcc-802c-487c-aaac-3bcde98aeaca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:04.014425 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2eb05dcc-802c-487c-aaac-3bcde98aeaca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:04.047954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2eb05dcc-802c-487c-aaac-3bcde98aeaca tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.268699 Aug 24 05:48:04.062519 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 212/425] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:03 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:04.257695 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-adc816c7-4447-4853-886a-e75420c01210 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:04.258560 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-adc816c7-4447-4853-886a-e75420c01210 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:04.265482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-adc816c7-4447-4853-886a-e75420c01210 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:04.266184 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-adc816c7-4447-4853-886a-e75420c01210 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:04.267299 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-adc816c7-4447-4853-886a-e75420c01210 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:04.268518 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-adc816c7-4447-4853-886a-e75420c01210 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:04.269103 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-adc816c7-4447-4853-886a-e75420c01210 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:04.269825 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-adc816c7-4447-4853-886a-e75420c01210 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:04.455641 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-adc816c7-4447-4853-886a-e75420c01210 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:04.459833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-adc816c7-4447-4853-886a-e75420c01210 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.206994 Aug 24 05:48:04.460606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 214/426] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:04 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:04.609763 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-23a0e05c-f868-4230-b47e-df7a88061ea4 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:04.610692 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-23a0e05c-f868-4230-b47e-df7a88061ea4 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:04.617429 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23a0e05c-f868-4230-b47e-df7a88061ea4 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:04.617940 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23a0e05c-f868-4230-b47e-df7a88061ea4 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:04.618378 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23a0e05c-f868-4230-b47e-df7a88061ea4 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:04.619089 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23a0e05c-f868-4230-b47e-df7a88061ea4 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:04.619545 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23a0e05c-f868-4230-b47e-df7a88061ea4 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:04.619971 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23a0e05c-f868-4230-b47e-df7a88061ea4 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:04.698270 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-23a0e05c-f868-4230-b47e-df7a88061ea4 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:04.707858 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-23a0e05c-f868-4230-b47e-df7a88061ea4 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1218 microversion: 2.1 time: 0.102299 Aug 24 05:48:04.709495 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 213/427] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:04 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:05.069225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-66209125-7259-4d3c-9f32-5719f1ff6c57 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:05.069853 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-66209125-7259-4d3c-9f32-5719f1ff6c57 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:05.076300 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66209125-7259-4d3c-9f32-5719f1ff6c57 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:05.076810 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66209125-7259-4d3c-9f32-5719f1ff6c57 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:05.077272 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66209125-7259-4d3c-9f32-5719f1ff6c57 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:05.078167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66209125-7259-4d3c-9f32-5719f1ff6c57 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:05.078628 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66209125-7259-4d3c-9f32-5719f1ff6c57 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:05.079553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66209125-7259-4d3c-9f32-5719f1ff6c57 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:05.284632 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66209125-7259-4d3c-9f32-5719f1ff6c57 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:05.300532 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-66209125-7259-4d3c-9f32-5719f1ff6c57 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.234267 Aug 24 05:48:05.301447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 215/428] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:05 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:05.493182 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-38f5487c-ba24-4c2b-90e1-99c879a025e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:05.493841 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-38f5487c-ba24-4c2b-90e1-99c879a025e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:05.501880 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-38f5487c-ba24-4c2b-90e1-99c879a025e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:05.507983 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-38f5487c-ba24-4c2b-90e1-99c879a025e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:05.507983 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-38f5487c-ba24-4c2b-90e1-99c879a025e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:05.507983 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-38f5487c-ba24-4c2b-90e1-99c879a025e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:05.507983 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-38f5487c-ba24-4c2b-90e1-99c879a025e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:05.508374 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-38f5487c-ba24-4c2b-90e1-99c879a025e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:05.677541 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-38f5487c-ba24-4c2b-90e1-99c879a025e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:05.688478 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-38f5487c-ba24-4c2b-90e1-99c879a025e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.198942 Aug 24 05:48:05.689237 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 214/429] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:05 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:05.730236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a47d0490-caf1-4240-ba20-12e0ec5dd037 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:05.730847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a47d0490-caf1-4240-ba20-12e0ec5dd037 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:05.737339 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a47d0490-caf1-4240-ba20-12e0ec5dd037 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:05.737827 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a47d0490-caf1-4240-ba20-12e0ec5dd037 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:05.738257 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a47d0490-caf1-4240-ba20-12e0ec5dd037 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:05.738960 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a47d0490-caf1-4240-ba20-12e0ec5dd037 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:05.739413 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a47d0490-caf1-4240-ba20-12e0ec5dd037 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:05.739832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a47d0490-caf1-4240-ba20-12e0ec5dd037 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:05.815077 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a47d0490-caf1-4240-ba20-12e0ec5dd037 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:05.823466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a47d0490-caf1-4240-ba20-12e0ec5dd037 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1218 microversion: 2.1 time: 0.097421 Aug 24 05:48:05.824053 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 216/430] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:05 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:06.322534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1e13a069-f7bb-4c82-99db-a750943327a7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:06.323154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1e13a069-f7bb-4c82-99db-a750943327a7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:06.329547 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e13a069-f7bb-4c82-99db-a750943327a7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.330205 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e13a069-f7bb-4c82-99db-a750943327a7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.331258 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e13a069-f7bb-4c82-99db-a750943327a7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.331527 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e13a069-f7bb-4c82-99db-a750943327a7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.331993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e13a069-f7bb-4c82-99db-a750943327a7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.332511 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e13a069-f7bb-4c82-99db-a750943327a7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.491094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1e13a069-f7bb-4c82-99db-a750943327a7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:06.498091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1e13a069-f7bb-4c82-99db-a750943327a7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.179756 Aug 24 05:48:06.499777 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 215/431] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:06 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:06.714875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4bcb8f59-f11e-4f71-8597-5242fd6d6989 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:06.715496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4bcb8f59-f11e-4f71-8597-5242fd6d6989 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:06.723050 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bcb8f59-f11e-4f71-8597-5242fd6d6989 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.723539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bcb8f59-f11e-4f71-8597-5242fd6d6989 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.723982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bcb8f59-f11e-4f71-8597-5242fd6d6989 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.724827 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bcb8f59-f11e-4f71-8597-5242fd6d6989 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.725301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bcb8f59-f11e-4f71-8597-5242fd6d6989 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.725749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bcb8f59-f11e-4f71-8597-5242fd6d6989 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.848669 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0a286643-1d45-41d9-a21f-dd5de2a1a1c8 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:06.849874 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0a286643-1d45-41d9-a21f-dd5de2a1a1c8 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:06.858304 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a286643-1d45-41d9-a21f-dd5de2a1a1c8 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.859087 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a286643-1d45-41d9-a21f-dd5de2a1a1c8 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.859905 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a286643-1d45-41d9-a21f-dd5de2a1a1c8 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.863262 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a286643-1d45-41d9-a21f-dd5de2a1a1c8 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.863918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a286643-1d45-41d9-a21f-dd5de2a1a1c8 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.864847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a286643-1d45-41d9-a21f-dd5de2a1a1c8 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.880712 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4bcb8f59-f11e-4f71-8597-5242fd6d6989 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:06.891261 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4bcb8f59-f11e-4f71-8597-5242fd6d6989 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.180153 Aug 24 05:48:06.903045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 217/432] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:06 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:06.955622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0a286643-1d45-41d9-a21f-dd5de2a1a1c8 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:06.963803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0a286643-1d45-41d9-a21f-dd5de2a1a1c8 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1218 microversion: 2.1 time: 0.122797 Aug 24 05:48:06.964323 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 216/433] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:06 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:07.532526 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1feb4dda-91fd-4662-8619-953134f1af49 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:07.533135 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1feb4dda-91fd-4662-8619-953134f1af49 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:07.539258 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1feb4dda-91fd-4662-8619-953134f1af49 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:07.539788 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1feb4dda-91fd-4662-8619-953134f1af49 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:07.540236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1feb4dda-91fd-4662-8619-953134f1af49 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:07.540964 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1feb4dda-91fd-4662-8619-953134f1af49 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:07.541424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1feb4dda-91fd-4662-8619-953134f1af49 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:07.541848 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1feb4dda-91fd-4662-8619-953134f1af49 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:07.700290 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1feb4dda-91fd-4662-8619-953134f1af49 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:07.709652 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1feb4dda-91fd-4662-8619-953134f1af49 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.181084 Aug 24 05:48:07.710335 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 218/434] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:07 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:07.917826 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1308261d-52b2-40aa-9c6a-ec4b91502034 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:07.918700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1308261d-52b2-40aa-9c6a-ec4b91502034 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:07.925822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1308261d-52b2-40aa-9c6a-ec4b91502034 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:07.926317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1308261d-52b2-40aa-9c6a-ec4b91502034 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:07.928120 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1308261d-52b2-40aa-9c6a-ec4b91502034 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:07.928120 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1308261d-52b2-40aa-9c6a-ec4b91502034 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:07.928120 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1308261d-52b2-40aa-9c6a-ec4b91502034 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:07.928430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1308261d-52b2-40aa-9c6a-ec4b91502034 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:07.986977 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-97ba7df3-de0c-406b-b585-c353c840c246 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:07.987542 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-97ba7df3-de0c-406b-b585-c353c840c246 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:07.994454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97ba7df3-de0c-406b-b585-c353c840c246 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:07.994952 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97ba7df3-de0c-406b-b585-c353c840c246 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:07.995393 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97ba7df3-de0c-406b-b585-c353c840c246 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:07.996113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97ba7df3-de0c-406b-b585-c353c840c246 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:07.996631 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97ba7df3-de0c-406b-b585-c353c840c246 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:07.997056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97ba7df3-de0c-406b-b585-c353c840c246 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:08.073388 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-97ba7df3-de0c-406b-b585-c353c840c246 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:08.082250 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-97ba7df3-de0c-406b-b585-c353c840c246 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1218 microversion: 2.1 time: 0.100180 Aug 24 05:48:08.082250 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 219/435] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:07 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:08.102590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1308261d-52b2-40aa-9c6a-ec4b91502034 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:08.111739 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1308261d-52b2-40aa-9c6a-ec4b91502034 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.197804 Aug 24 05:48:08.112345 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 217/436] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:07 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:08.731737 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-28e3522c-c47f-4e80-a2ef-25adb3844688 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:08.732336 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-28e3522c-c47f-4e80-a2ef-25adb3844688 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:08.738671 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28e3522c-c47f-4e80-a2ef-25adb3844688 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:08.739149 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28e3522c-c47f-4e80-a2ef-25adb3844688 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:08.739581 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28e3522c-c47f-4e80-a2ef-25adb3844688 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:08.740265 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28e3522c-c47f-4e80-a2ef-25adb3844688 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:08.740742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28e3522c-c47f-4e80-a2ef-25adb3844688 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:08.741163 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28e3522c-c47f-4e80-a2ef-25adb3844688 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:08.869402 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-28e3522c-c47f-4e80-a2ef-25adb3844688 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:08.877128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-28e3522c-c47f-4e80-a2ef-25adb3844688 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.149230 Aug 24 05:48:08.877685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 220/437] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:08 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:09.103045 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-769bb982-4cf9-4a99-bee9-93c95b67eec6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:09.103590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-769bb982-4cf9-4a99-bee9-93c95b67eec6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:09.109674 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-769bb982-4cf9-4a99-bee9-93c95b67eec6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.110541 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-769bb982-4cf9-4a99-bee9-93c95b67eec6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.111281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-769bb982-4cf9-4a99-bee9-93c95b67eec6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.112021 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-769bb982-4cf9-4a99-bee9-93c95b67eec6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.112514 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-769bb982-4cf9-4a99-bee9-93c95b67eec6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.112950 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-769bb982-4cf9-4a99-bee9-93c95b67eec6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.136380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9f8b9a2f-b0fb-457f-a5fb-d43162e795a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:09.137012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9f8b9a2f-b0fb-457f-a5fb-d43162e795a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:09.147090 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f8b9a2f-b0fb-457f-a5fb-d43162e795a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.147578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f8b9a2f-b0fb-457f-a5fb-d43162e795a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.148019 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f8b9a2f-b0fb-457f-a5fb-d43162e795a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.148764 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f8b9a2f-b0fb-457f-a5fb-d43162e795a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.149224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f8b9a2f-b0fb-457f-a5fb-d43162e795a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.149653 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f8b9a2f-b0fb-457f-a5fb-d43162e795a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.180122 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-769bb982-4cf9-4a99-bee9-93c95b67eec6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:09.189525 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-769bb982-4cf9-4a99-bee9-93c95b67eec6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1218 microversion: 2.1 time: 0.089501 Aug 24 05:48:09.190043 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 218/438] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:09 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:09.287191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9f8b9a2f-b0fb-457f-a5fb-d43162e795a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:09.295427 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9f8b9a2f-b0fb-457f-a5fb-d43162e795a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.162820 Aug 24 05:48:09.296012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 221/439] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:09 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:09.897640 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-edeed1ef-733e-401e-bb24-75301ae270b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:09.898254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-edeed1ef-733e-401e-bb24-75301ae270b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:09.900174 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:09.905605 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edeed1ef-733e-401e-bb24-75301ae270b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.906093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edeed1ef-733e-401e-bb24-75301ae270b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.923483 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edeed1ef-733e-401e-bb24-75301ae270b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.923483 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edeed1ef-733e-401e-bb24-75301ae270b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.923483 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edeed1ef-733e-401e-bb24-75301ae270b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.923483 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-edeed1ef-733e-401e-bb24-75301ae270b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:10.044898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-edeed1ef-733e-401e-bb24-75301ae270b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:10.052536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-edeed1ef-733e-401e-bb24-75301ae270b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.158801 Aug 24 05:48:10.053104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 219/440] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:09 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:10.210748 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f4a1dc39-830e-47ee-a742-f41e594bdf20 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:10.211623 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f4a1dc39-830e-47ee-a742-f41e594bdf20 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:10.218283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f4a1dc39-830e-47ee-a742-f41e594bdf20 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:10.218762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f4a1dc39-830e-47ee-a742-f41e594bdf20 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:10.219198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f4a1dc39-830e-47ee-a742-f41e594bdf20 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:10.220539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f4a1dc39-830e-47ee-a742-f41e594bdf20 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:10.220998 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f4a1dc39-830e-47ee-a742-f41e594bdf20 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:10.221421 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f4a1dc39-830e-47ee-a742-f41e594bdf20 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:10.282865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f4a1dc39-830e-47ee-a742-f41e594bdf20 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:10.290694 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f4a1dc39-830e-47ee-a742-f41e594bdf20 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1218 microversion: 2.1 time: 0.083810 Aug 24 05:48:10.291251 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 222/441] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:10 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:10.315605 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2e2eee4b-ffbc-481b-bb5a-52bd0b0d8c30 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:10.316214 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2e2eee4b-ffbc-481b-bb5a-52bd0b0d8c30 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:10.318084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=8 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:10.322897 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2e2eee4b-ffbc-481b-bb5a-52bd0b0d8c30 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:10.327984 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2e2eee4b-ffbc-481b-bb5a-52bd0b0d8c30 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:10.327984 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2e2eee4b-ffbc-481b-bb5a-52bd0b0d8c30 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:10.327984 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2e2eee4b-ffbc-481b-bb5a-52bd0b0d8c30 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:10.327984 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2e2eee4b-ffbc-481b-bb5a-52bd0b0d8c30 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:10.328328 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2e2eee4b-ffbc-481b-bb5a-52bd0b0d8c30 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:10.460429 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2e2eee4b-ffbc-481b-bb5a-52bd0b0d8c30 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:10.467949 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2e2eee4b-ffbc-481b-bb5a-52bd0b0d8c30 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.156807 Aug 24 05:48:10.470725 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 220/442] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:10 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:11.072911 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ebb61f6f-8499-4285-a5a6-a6fdd313955f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:11.073521 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ebb61f6f-8499-4285-a5a6-a6fdd313955f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:11.081712 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ebb61f6f-8499-4285-a5a6-a6fdd313955f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:11.082213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ebb61f6f-8499-4285-a5a6-a6fdd313955f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:11.082655 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ebb61f6f-8499-4285-a5a6-a6fdd313955f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:11.083361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ebb61f6f-8499-4285-a5a6-a6fdd313955f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:11.083844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ebb61f6f-8499-4285-a5a6-a6fdd313955f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:11.085371 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ebb61f6f-8499-4285-a5a6-a6fdd313955f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:11.098055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:11.226325 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ebb61f6f-8499-4285-a5a6-a6fdd313955f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:11.236260 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ebb61f6f-8499-4285-a5a6-a6fdd313955f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.166462 Aug 24 05:48:11.236912 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 223/443] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:11 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:11.312698 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d4b01cda-37c0-466d-a316-e2acc6932681 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:11.313210 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d4b01cda-37c0-466d-a316-e2acc6932681 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:11.319940 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4b01cda-37c0-466d-a316-e2acc6932681 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:11.320569 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4b01cda-37c0-466d-a316-e2acc6932681 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:11.320883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4b01cda-37c0-466d-a316-e2acc6932681 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:11.321581 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4b01cda-37c0-466d-a316-e2acc6932681 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:11.322043 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4b01cda-37c0-466d-a316-e2acc6932681 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:11.322474 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d4b01cda-37c0-466d-a316-e2acc6932681 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:11.387482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d4b01cda-37c0-466d-a316-e2acc6932681 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:11.396071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d4b01cda-37c0-466d-a316-e2acc6932681 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1218 microversion: 2.1 time: 0.087497 Aug 24 05:48:11.396687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 221/444] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:11 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:11.490212 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f75062bc-b029-45a8-8717-57a785a940f9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:11.490818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f75062bc-b029-45a8-8717-57a785a940f9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:11.492803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:11.498120 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f75062bc-b029-45a8-8717-57a785a940f9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:11.498631 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f75062bc-b029-45a8-8717-57a785a940f9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:11.499133 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f75062bc-b029-45a8-8717-57a785a940f9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:11.499797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f75062bc-b029-45a8-8717-57a785a940f9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:11.500255 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f75062bc-b029-45a8-8717-57a785a940f9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:11.500723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f75062bc-b029-45a8-8717-57a785a940f9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:11.641360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f75062bc-b029-45a8-8717-57a785a940f9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:11.650853 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f75062bc-b029-45a8-8717-57a785a940f9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.165427 Aug 24 05:48:11.651439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 224/445] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:11 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:12.257626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9d4e6c05-e612-4fbb-b20e-f1a9d2ac9fa2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:12.258247 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9d4e6c05-e612-4fbb-b20e-f1a9d2ac9fa2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:12.264242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d4e6c05-e612-4fbb-b20e-f1a9d2ac9fa2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:12.264750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d4e6c05-e612-4fbb-b20e-f1a9d2ac9fa2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:12.265184 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d4e6c05-e612-4fbb-b20e-f1a9d2ac9fa2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:12.265931 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d4e6c05-e612-4fbb-b20e-f1a9d2ac9fa2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:12.266386 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d4e6c05-e612-4fbb-b20e-f1a9d2ac9fa2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:12.267512 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d4e6c05-e612-4fbb-b20e-f1a9d2ac9fa2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:12.403734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9d4e6c05-e612-4fbb-b20e-f1a9d2ac9fa2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:12.412155 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9d4e6c05-e612-4fbb-b20e-f1a9d2ac9fa2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.158363 Aug 24 05:48:12.412815 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 222/446] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:12 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:12.417443 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a75ed1bb-6d02-4dd1-a80d-8ba3d0d97997 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:12.418312 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a75ed1bb-6d02-4dd1-a80d-8ba3d0d97997 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:12.425537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75ed1bb-6d02-4dd1-a80d-8ba3d0d97997 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:12.426022 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75ed1bb-6d02-4dd1-a80d-8ba3d0d97997 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:12.426466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75ed1bb-6d02-4dd1-a80d-8ba3d0d97997 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:12.427159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75ed1bb-6d02-4dd1-a80d-8ba3d0d97997 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:12.427623 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75ed1bb-6d02-4dd1-a80d-8ba3d0d97997 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:12.428047 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75ed1bb-6d02-4dd1-a80d-8ba3d0d97997 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:12.489968 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a75ed1bb-6d02-4dd1-a80d-8ba3d0d97997 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:12.497801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a75ed1bb-6d02-4dd1-a80d-8ba3d0d97997 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1218 microversion: 2.1 time: 0.084121 Aug 24 05:48:12.498324 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 225/447] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:12 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:12.671799 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a72a4ffc-7450-4c86-a9c8-4b9bdedb9d96 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:12.672422 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a72a4ffc-7450-4c86-a9c8-4b9bdedb9d96 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:12.679139 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a72a4ffc-7450-4c86-a9c8-4b9bdedb9d96 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:12.679645 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a72a4ffc-7450-4c86-a9c8-4b9bdedb9d96 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:12.680088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a72a4ffc-7450-4c86-a9c8-4b9bdedb9d96 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:12.680827 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a72a4ffc-7450-4c86-a9c8-4b9bdedb9d96 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:12.681290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a72a4ffc-7450-4c86-a9c8-4b9bdedb9d96 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:12.681716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a72a4ffc-7450-4c86-a9c8-4b9bdedb9d96 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:12.829486 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a72a4ffc-7450-4c86-a9c8-4b9bdedb9d96 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:12.836633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a72a4ffc-7450-4c86-a9c8-4b9bdedb9d96 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.168995 Aug 24 05:48:12.837245 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 223/448] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:12 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:13.433451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c77595cf-56ca-4e0f-824b-fa92e9ae9d86 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:13.434100 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c77595cf-56ca-4e0f-824b-fa92e9ae9d86 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:13.442342 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c77595cf-56ca-4e0f-824b-fa92e9ae9d86 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.442776 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c77595cf-56ca-4e0f-824b-fa92e9ae9d86 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.443387 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c77595cf-56ca-4e0f-824b-fa92e9ae9d86 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:13.444105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c77595cf-56ca-4e0f-824b-fa92e9ae9d86 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.444596 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c77595cf-56ca-4e0f-824b-fa92e9ae9d86 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.445036 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c77595cf-56ca-4e0f-824b-fa92e9ae9d86 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:13.518475 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-447ce999-2306-4314-8762-63d5c8ae9b5c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:13.519093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-447ce999-2306-4314-8762-63d5c8ae9b5c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:13.525091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-447ce999-2306-4314-8762-63d5c8ae9b5c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.525574 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-447ce999-2306-4314-8762-63d5c8ae9b5c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.526005 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-447ce999-2306-4314-8762-63d5c8ae9b5c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:13.526696 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-447ce999-2306-4314-8762-63d5c8ae9b5c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.527585 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-447ce999-2306-4314-8762-63d5c8ae9b5c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.527585 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-447ce999-2306-4314-8762-63d5c8ae9b5c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:13.546343 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:13.607454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-447ce999-2306-4314-8762-63d5c8ae9b5c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:13.611439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c77595cf-56ca-4e0f-824b-fa92e9ae9d86 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:13.615790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-447ce999-2306-4314-8762-63d5c8ae9b5c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1218 microversion: 2.1 time: 0.101345 Aug 24 05:48:13.616481 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 224/449] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:13 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:13.622454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c77595cf-56ca-4e0f-824b-fa92e9ae9d86 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.192728 Aug 24 05:48:13.623536 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 226/450] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:13 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:13.862010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-057e9509-2b46-4767-865c-88a919c73847 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:13.862623 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-057e9509-2b46-4767-865c-88a919c73847 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:13.868730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-057e9509-2b46-4767-865c-88a919c73847 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.869290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-057e9509-2b46-4767-865c-88a919c73847 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.869732 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-057e9509-2b46-4767-865c-88a919c73847 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:13.870430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-057e9509-2b46-4767-865c-88a919c73847 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.870888 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-057e9509-2b46-4767-865c-88a919c73847 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.871314 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-057e9509-2b46-4767-865c-88a919c73847 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:14.020526 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-057e9509-2b46-4767-865c-88a919c73847 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:14.028995 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-057e9509-2b46-4767-865c-88a919c73847 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.171497 Aug 24 05:48:14.033381 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 225/451] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:13 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:14.639603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c1240555-cb8e-45a0-a687-c62fab8b0f23 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:14.640892 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c1240555-cb8e-45a0-a687-c62fab8b0f23 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:14.646772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-042d7522-255a-4f2d-a7fa-fa9f2c61429f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:14.647606 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-042d7522-255a-4f2d-a7fa-fa9f2c61429f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:14.652177 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1240555-cb8e-45a0-a687-c62fab8b0f23 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:14.656082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1240555-cb8e-45a0-a687-c62fab8b0f23 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:14.656082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1240555-cb8e-45a0-a687-c62fab8b0f23 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:14.656082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1240555-cb8e-45a0-a687-c62fab8b0f23 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:14.656633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042d7522-255a-4f2d-a7fa-fa9f2c61429f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:14.656814 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1240555-cb8e-45a0-a687-c62fab8b0f23 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:14.656981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042d7522-255a-4f2d-a7fa-fa9f2c61429f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:14.657153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1240555-cb8e-45a0-a687-c62fab8b0f23 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:14.657342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042d7522-255a-4f2d-a7fa-fa9f2c61429f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:14.657342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042d7522-255a-4f2d-a7fa-fa9f2c61429f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:14.657342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042d7522-255a-4f2d-a7fa-fa9f2c61429f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:14.657342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042d7522-255a-4f2d-a7fa-fa9f2c61429f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:14.747607 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c1240555-cb8e-45a0-a687-c62fab8b0f23 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:14.755966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c1240555-cb8e-45a0-a687-c62fab8b0f23 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1210 microversion: 2.1 time: 0.120795 Aug 24 05:48:14.756564 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 227/452] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:14 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1210 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:14.825059 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-042d7522-255a-4f2d-a7fa-fa9f2c61429f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:14.833268 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-042d7522-255a-4f2d-a7fa-fa9f2c61429f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.192010 Aug 24 05:48:14.835869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 226/453] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:14 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:15.059506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a077a126-30b4-4254-9ba9-dcc1d44c5e0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:15.060328 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a077a126-30b4-4254-9ba9-dcc1d44c5e0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:15.062987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=72 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:15.070586 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a077a126-30b4-4254-9ba9-dcc1d44c5e0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:15.071151 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a077a126-30b4-4254-9ba9-dcc1d44c5e0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:15.071612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a077a126-30b4-4254-9ba9-dcc1d44c5e0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:15.072363 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a077a126-30b4-4254-9ba9-dcc1d44c5e0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:15.072786 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a077a126-30b4-4254-9ba9-dcc1d44c5e0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:15.073206 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a077a126-30b4-4254-9ba9-dcc1d44c5e0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:15.226232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a077a126-30b4-4254-9ba9-dcc1d44c5e0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:15.235029 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a077a126-30b4-4254-9ba9-dcc1d44c5e0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.180296 Aug 24 05:48:15.237262 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 228/454] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:15 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:15.777466 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-572be81a-49ba-41e2-8a79-0940029f75f0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:15.778057 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-572be81a-49ba-41e2-8a79-0940029f75f0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:15.786418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-572be81a-49ba-41e2-8a79-0940029f75f0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:15.787065 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-572be81a-49ba-41e2-8a79-0940029f75f0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:15.787625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-572be81a-49ba-41e2-8a79-0940029f75f0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:15.788422 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-572be81a-49ba-41e2-8a79-0940029f75f0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:15.788943 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-572be81a-49ba-41e2-8a79-0940029f75f0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:15.789504 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-572be81a-49ba-41e2-8a79-0940029f75f0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:15.855059 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8df494ca-5bb2-4dcf-8aec-475081c34d6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:15.855676 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8df494ca-5bb2-4dcf-8aec-475081c34d6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:15.856182 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-572be81a-49ba-41e2-8a79-0940029f75f0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:15.864219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8df494ca-5bb2-4dcf-8aec-475081c34d6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:15.864889 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-572be81a-49ba-41e2-8a79-0940029f75f0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.091253 Aug 24 05:48:15.870691 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8df494ca-5bb2-4dcf-8aec-475081c34d6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:15.870862 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 227/455] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:15 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:15.870973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8df494ca-5bb2-4dcf-8aec-475081c34d6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:15.870973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8df494ca-5bb2-4dcf-8aec-475081c34d6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:15.870973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8df494ca-5bb2-4dcf-8aec-475081c34d6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:15.870973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8df494ca-5bb2-4dcf-8aec-475081c34d6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:16.011904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8df494ca-5bb2-4dcf-8aec-475081c34d6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:16.019832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8df494ca-5bb2-4dcf-8aec-475081c34d6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.168660 Aug 24 05:48:16.020512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 229/456] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:15 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:16.257102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e75508ea-0b9c-4493-b3a8-4f4665b7b8ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:16.257794 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e75508ea-0b9c-4493-b3a8-4f4665b7b8ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:16.271590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e75508ea-0b9c-4493-b3a8-4f4665b7b8ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:16.271590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e75508ea-0b9c-4493-b3a8-4f4665b7b8ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:16.271590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e75508ea-0b9c-4493-b3a8-4f4665b7b8ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:16.271590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e75508ea-0b9c-4493-b3a8-4f4665b7b8ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:16.271921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e75508ea-0b9c-4493-b3a8-4f4665b7b8ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:16.271921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e75508ea-0b9c-4493-b3a8-4f4665b7b8ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:16.405472 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e75508ea-0b9c-4493-b3a8-4f4665b7b8ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:16.416000 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e75508ea-0b9c-4493-b3a8-4f4665b7b8ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.162659 Aug 24 05:48:16.416865 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 228/457] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:16 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:16.885963 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b88290cb-8b8e-45b2-94d4-2c593ae29671 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:16.886580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b88290cb-8b8e-45b2-94d4-2c593ae29671 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:16.894979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b88290cb-8b8e-45b2-94d4-2c593ae29671 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:16.895469 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b88290cb-8b8e-45b2-94d4-2c593ae29671 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:16.895918 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b88290cb-8b8e-45b2-94d4-2c593ae29671 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:16.896652 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b88290cb-8b8e-45b2-94d4-2c593ae29671 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:16.897157 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b88290cb-8b8e-45b2-94d4-2c593ae29671 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:16.897587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b88290cb-8b8e-45b2-94d4-2c593ae29671 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:16.966021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b88290cb-8b8e-45b2-94d4-2c593ae29671 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:16.975483 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b88290cb-8b8e-45b2-94d4-2c593ae29671 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.093374 Aug 24 05:48:16.976279 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 230/458] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:16 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:17.042248 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ba359a66-a317-41df-9cea-2d07b5e50a91 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:17.042820 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ba359a66-a317-41df-9cea-2d07b5e50a91 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:17.050314 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ba359a66-a317-41df-9cea-2d07b5e50a91 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:17.055453 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ba359a66-a317-41df-9cea-2d07b5e50a91 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:17.055453 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ba359a66-a317-41df-9cea-2d07b5e50a91 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:17.055453 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ba359a66-a317-41df-9cea-2d07b5e50a91 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:17.055453 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ba359a66-a317-41df-9cea-2d07b5e50a91 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:17.055850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ba359a66-a317-41df-9cea-2d07b5e50a91 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:17.208809 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ba359a66-a317-41df-9cea-2d07b5e50a91 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:17.216525 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ba359a66-a317-41df-9cea-2d07b5e50a91 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.178245 Aug 24 05:48:17.217177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 229/459] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:17 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:17.437697 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-72f727b0-e27a-45e7-8385-f7ac9a4bf1f5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:17.438841 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-72f727b0-e27a-45e7-8385-f7ac9a4bf1f5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:17.444960 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f727b0-e27a-45e7-8385-f7ac9a4bf1f5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:17.445440 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f727b0-e27a-45e7-8385-f7ac9a4bf1f5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:17.445870 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f727b0-e27a-45e7-8385-f7ac9a4bf1f5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:17.446560 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f727b0-e27a-45e7-8385-f7ac9a4bf1f5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:17.447013 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f727b0-e27a-45e7-8385-f7ac9a4bf1f5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:17.447432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72f727b0-e27a-45e7-8385-f7ac9a4bf1f5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:17.589917 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-72f727b0-e27a-45e7-8385-f7ac9a4bf1f5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:17.603874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-72f727b0-e27a-45e7-8385-f7ac9a4bf1f5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.166143 Aug 24 05:48:17.603874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 231/460] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:17 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:17.997338 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6e84c99e-aaf0-49cb-8254-b28a2302425d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:17.997953 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6e84c99e-aaf0-49cb-8254-b28a2302425d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:18.005366 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6e84c99e-aaf0-49cb-8254-b28a2302425d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:18.005861 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6e84c99e-aaf0-49cb-8254-b28a2302425d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:18.006300 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6e84c99e-aaf0-49cb-8254-b28a2302425d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:18.007005 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6e84c99e-aaf0-49cb-8254-b28a2302425d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:18.007471 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6e84c99e-aaf0-49cb-8254-b28a2302425d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:18.007898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6e84c99e-aaf0-49cb-8254-b28a2302425d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:18.082366 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6e84c99e-aaf0-49cb-8254-b28a2302425d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:18.090296 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6e84c99e-aaf0-49cb-8254-b28a2302425d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.096832 Aug 24 05:48:18.090873 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 230/461] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:17 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:18.238678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-dfa0de8f-5d6d-4a86-926d-bdf930ae61a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:18.239286 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-dfa0de8f-5d6d-4a86-926d-bdf930ae61a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:18.246184 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dfa0de8f-5d6d-4a86-926d-bdf930ae61a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:18.246673 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dfa0de8f-5d6d-4a86-926d-bdf930ae61a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:18.247112 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dfa0de8f-5d6d-4a86-926d-bdf930ae61a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:18.247892 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dfa0de8f-5d6d-4a86-926d-bdf930ae61a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:18.248282 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dfa0de8f-5d6d-4a86-926d-bdf930ae61a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:18.248747 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dfa0de8f-5d6d-4a86-926d-bdf930ae61a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:18.405088 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dfa0de8f-5d6d-4a86-926d-bdf930ae61a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:18.416857 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-dfa0de8f-5d6d-4a86-926d-bdf930ae61a4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.182415 Aug 24 05:48:18.417459 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 232/462] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:18 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:18.621722 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f8adeec9-3a6a-4cf3-9bd2-6993ab1b6d00 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:18.622257 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f8adeec9-3a6a-4cf3-9bd2-6993ab1b6d00 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:18.629558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f8adeec9-3a6a-4cf3-9bd2-6993ab1b6d00 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:18.630050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f8adeec9-3a6a-4cf3-9bd2-6993ab1b6d00 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:18.630492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f8adeec9-3a6a-4cf3-9bd2-6993ab1b6d00 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:18.631202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f8adeec9-3a6a-4cf3-9bd2-6993ab1b6d00 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:18.631660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f8adeec9-3a6a-4cf3-9bd2-6993ab1b6d00 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:18.632088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f8adeec9-3a6a-4cf3-9bd2-6993ab1b6d00 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:18.909135 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f8adeec9-3a6a-4cf3-9bd2-6993ab1b6d00 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:18.909135 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f8adeec9-3a6a-4cf3-9bd2-6993ab1b6d00 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.169572 Aug 24 05:48:18.909135 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 231/463] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:18 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:19.113697 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5869489d-b579-4757-b863-027dbca19a38 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:19.114314 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5869489d-b579-4757-b863-027dbca19a38 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:19.122372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5869489d-b579-4757-b863-027dbca19a38 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:19.122372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5869489d-b579-4757-b863-027dbca19a38 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:19.122372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5869489d-b579-4757-b863-027dbca19a38 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:19.122816 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5869489d-b579-4757-b863-027dbca19a38 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:19.123263 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5869489d-b579-4757-b863-027dbca19a38 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:19.123690 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5869489d-b579-4757-b863-027dbca19a38 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:19.217929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5869489d-b579-4757-b863-027dbca19a38 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:19.227335 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5869489d-b579-4757-b863-027dbca19a38 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.118000 Aug 24 05:48:19.227939 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 233/464] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:19 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:19.438212 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e224110a-f47c-480d-9628-7e44d83a4684 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:19.438748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e224110a-f47c-480d-9628-7e44d83a4684 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:19.445050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e224110a-f47c-480d-9628-7e44d83a4684 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:19.445542 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e224110a-f47c-480d-9628-7e44d83a4684 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:19.446047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e224110a-f47c-480d-9628-7e44d83a4684 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:19.446766 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e224110a-f47c-480d-9628-7e44d83a4684 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:19.447222 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e224110a-f47c-480d-9628-7e44d83a4684 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:19.447642 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e224110a-f47c-480d-9628-7e44d83a4684 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:19.595619 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e224110a-f47c-480d-9628-7e44d83a4684 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:19.606360 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e224110a-f47c-480d-9628-7e44d83a4684 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.171817 Aug 24 05:48:19.607122 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 232/465] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:19 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:19.810948 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-97e58adb-1de4-4590-b206-8b82494ac40e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:19.811499 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-97e58adb-1de4-4590-b206-8b82494ac40e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:19.818790 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97e58adb-1de4-4590-b206-8b82494ac40e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:19.819274 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97e58adb-1de4-4590-b206-8b82494ac40e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:19.819700 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97e58adb-1de4-4590-b206-8b82494ac40e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:19.820424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97e58adb-1de4-4590-b206-8b82494ac40e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:19.820874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97e58adb-1de4-4590-b206-8b82494ac40e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:19.821289 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-97e58adb-1de4-4590-b206-8b82494ac40e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:19.970978 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-97e58adb-1de4-4590-b206-8b82494ac40e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:19.979347 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-97e58adb-1de4-4590-b206-8b82494ac40e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.172262 Aug 24 05:48:19.979917 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 234/466] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:19 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:20.249258 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4c2c578e-6b46-4651-bac9-bf475980f2e6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:20.249905 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4c2c578e-6b46-4651-bac9-bf475980f2e6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:20.252958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:20.257675 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c2c578e-6b46-4651-bac9-bf475980f2e6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.258162 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c2c578e-6b46-4651-bac9-bf475980f2e6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.258600 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c2c578e-6b46-4651-bac9-bf475980f2e6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.259303 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c2c578e-6b46-4651-bac9-bf475980f2e6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.259759 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c2c578e-6b46-4651-bac9-bf475980f2e6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.260166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c2c578e-6b46-4651-bac9-bf475980f2e6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.329128 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4c2c578e-6b46-4651-bac9-bf475980f2e6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:20.338606 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4c2c578e-6b46-4651-bac9-bf475980f2e6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.091498 Aug 24 05:48:20.338606 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 233/467] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:20 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:20.630526 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a9f63963-88d1-4031-bb19-cb48dae69537 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:20.632954 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a9f63963-88d1-4031-bb19-cb48dae69537 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:20.639954 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f63963-88d1-4031-bb19-cb48dae69537 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.642751 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f63963-88d1-4031-bb19-cb48dae69537 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.642751 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f63963-88d1-4031-bb19-cb48dae69537 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.642751 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f63963-88d1-4031-bb19-cb48dae69537 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.643204 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f63963-88d1-4031-bb19-cb48dae69537 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.643433 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f63963-88d1-4031-bb19-cb48dae69537 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.787619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a9f63963-88d1-4031-bb19-cb48dae69537 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:20.796387 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a9f63963-88d1-4031-bb19-cb48dae69537 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.171723 Aug 24 05:48:20.797078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 235/468] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:20 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:20.999751 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b2832c70-d78a-48a3-8bd0-cbc646ece77c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:21.000416 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b2832c70-d78a-48a3-8bd0-cbc646ece77c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:21.007687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2832c70-d78a-48a3-8bd0-cbc646ece77c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.008271 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2832c70-d78a-48a3-8bd0-cbc646ece77c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.008776 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2832c70-d78a-48a3-8bd0-cbc646ece77c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:21.009476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2832c70-d78a-48a3-8bd0-cbc646ece77c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.009937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2832c70-d78a-48a3-8bd0-cbc646ece77c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.010387 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b2832c70-d78a-48a3-8bd0-cbc646ece77c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:21.149523 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b2832c70-d78a-48a3-8bd0-cbc646ece77c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:21.159173 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b2832c70-d78a-48a3-8bd0-cbc646ece77c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.163538 Aug 24 05:48:21.159958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 234/469] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:20 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:21.358660 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-66e88b82-6cf5-4769-a957-95b665013da9 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:21.359270 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-66e88b82-6cf5-4769-a957-95b665013da9 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:21.365912 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66e88b82-6cf5-4769-a957-95b665013da9 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.366402 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66e88b82-6cf5-4769-a957-95b665013da9 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.366843 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66e88b82-6cf5-4769-a957-95b665013da9 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:21.367537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66e88b82-6cf5-4769-a957-95b665013da9 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.367998 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66e88b82-6cf5-4769-a957-95b665013da9 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.368456 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66e88b82-6cf5-4769-a957-95b665013da9 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:21.436129 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66e88b82-6cf5-4769-a957-95b665013da9 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:21.444619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-66e88b82-6cf5-4769-a957-95b665013da9 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.089673 Aug 24 05:48:21.445193 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 236/470] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:21 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:21.821157 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7a785a41-ef3c-4e1d-8f49-9649098d1493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:21.822029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7a785a41-ef3c-4e1d-8f49-9649098d1493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:21.829557 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a785a41-ef3c-4e1d-8f49-9649098d1493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.830008 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a785a41-ef3c-4e1d-8f49-9649098d1493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.830436 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a785a41-ef3c-4e1d-8f49-9649098d1493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:21.831260 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a785a41-ef3c-4e1d-8f49-9649098d1493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.831903 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a785a41-ef3c-4e1d-8f49-9649098d1493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.832289 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a785a41-ef3c-4e1d-8f49-9649098d1493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:21.986774 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7a785a41-ef3c-4e1d-8f49-9649098d1493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:21.995195 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7a785a41-ef3c-4e1d-8f49-9649098d1493 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1370 microversion: 2.1 time: 0.179396 Aug 24 05:48:21.996625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 235/471] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:21 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:22.181391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6d568148-f3b6-49a2-b561-297ccff8cb0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:22.182008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6d568148-f3b6-49a2-b561-297ccff8cb0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:22.189125 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6d568148-f3b6-49a2-b561-297ccff8cb0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:22.189619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6d568148-f3b6-49a2-b561-297ccff8cb0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:22.190055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6d568148-f3b6-49a2-b561-297ccff8cb0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:22.190750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6d568148-f3b6-49a2-b561-297ccff8cb0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:22.191203 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6d568148-f3b6-49a2-b561-297ccff8cb0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:22.191625 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6d568148-f3b6-49a2-b561-297ccff8cb0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:22.319987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6d568148-f3b6-49a2-b561-297ccff8cb0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:22.327799 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6d568148-f3b6-49a2-b561-297ccff8cb0a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.150300 Aug 24 05:48:22.328969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 237/472] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:22 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:22.472604 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2f54f2db-344a-4578-be4a-1b41501295b3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:22.472604 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2f54f2db-344a-4578-be4a-1b41501295b3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:22.474071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f54f2db-344a-4578-be4a-1b41501295b3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:22.474576 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f54f2db-344a-4578-be4a-1b41501295b3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:22.474992 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f54f2db-344a-4578-be4a-1b41501295b3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:22.475688 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f54f2db-344a-4578-be4a-1b41501295b3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:22.476148 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f54f2db-344a-4578-be4a-1b41501295b3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:22.476681 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f54f2db-344a-4578-be4a-1b41501295b3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:22.555067 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2f54f2db-344a-4578-be4a-1b41501295b3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:22.563425 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2f54f2db-344a-4578-be4a-1b41501295b3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.100727 Aug 24 05:48:22.564065 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 236/473] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:22 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:23.017427 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-307ceea1-c16e-432a-bf06-2f7783e599f9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:23.018075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-307ceea1-c16e-432a-bf06-2f7783e599f9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:23.026074 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-307ceea1-c16e-432a-bf06-2f7783e599f9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.026638 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-307ceea1-c16e-432a-bf06-2f7783e599f9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.027273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-307ceea1-c16e-432a-bf06-2f7783e599f9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.028152 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-307ceea1-c16e-432a-bf06-2f7783e599f9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.028802 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-307ceea1-c16e-432a-bf06-2f7783e599f9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.029342 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-307ceea1-c16e-432a-bf06-2f7783e599f9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.179602 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-307ceea1-c16e-432a-bf06-2f7783e599f9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:23.190209 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-307ceea1-c16e-432a-bf06-2f7783e599f9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1563 microversion: 2.1 time: 0.176871 Aug 24 05:48:23.190635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 238/474] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:23 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:23.221072 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-74712792-be9d-4095-801b-8f4cbdedcade tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:23.223938 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-74712792-be9d-4095-801b-8f4cbdedcade tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:23.227779 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74712792-be9d-4095-801b-8f4cbdedcade tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.228270 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74712792-be9d-4095-801b-8f4cbdedcade tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.228738 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74712792-be9d-4095-801b-8f4cbdedcade tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.229440 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74712792-be9d-4095-801b-8f4cbdedcade tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.229893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74712792-be9d-4095-801b-8f4cbdedcade tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.230394 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74712792-be9d-4095-801b-8f4cbdedcade tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.312273 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-74712792-be9d-4095-801b-8f4cbdedcade tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095299 Aug 24 05:48:23.312933 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 237/475] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 24 05:48:23 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:23.349477 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-cfb5a9d3-cc00-4bad-8a57-7a159597699e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:23.350087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-cfb5a9d3-cc00-4bad-8a57-7a159597699e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:23.356155 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cfb5a9d3-cc00-4bad-8a57-7a159597699e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.356675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cfb5a9d3-cc00-4bad-8a57-7a159597699e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.357118 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cfb5a9d3-cc00-4bad-8a57-7a159597699e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.357818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cfb5a9d3-cc00-4bad-8a57-7a159597699e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.358274 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cfb5a9d3-cc00-4bad-8a57-7a159597699e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.358701 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cfb5a9d3-cc00-4bad-8a57-7a159597699e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.586528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-798211c7-7ce9-43da-b513-39bc6d9bf43f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:23.586528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-798211c7-7ce9-43da-b513-39bc6d9bf43f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:23.591798 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-798211c7-7ce9-43da-b513-39bc6d9bf43f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.592280 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-798211c7-7ce9-43da-b513-39bc6d9bf43f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.592758 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-798211c7-7ce9-43da-b513-39bc6d9bf43f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.593449 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-798211c7-7ce9-43da-b513-39bc6d9bf43f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.593905 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-798211c7-7ce9-43da-b513-39bc6d9bf43f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.594335 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-798211c7-7ce9-43da-b513-39bc6d9bf43f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.904590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cfb5a9d3-cc00-4bad-8a57-7a159597699e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:23.907653 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:23.913822 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-cfb5a9d3-cc00-4bad-8a57-7a159597699e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.568444 Aug 24 05:48:23.914397 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 239/476] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:23 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:23.926736 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-798211c7-7ce9-43da-b513-39bc6d9bf43f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:23.934500 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-798211c7-7ce9-43da-b513-39bc6d9bf43f tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.353083 Aug 24 05:48:23.935155 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 238/477] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:23 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:24.856900 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-074aaafc-651f-464d-bc62-cf7e892a0afc req-9f1d0870-f5b5-4076-ae44-b1840ec01e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64eb4995-d137-42b3-96b4-1af57d704189", "tag": "9f61d38a-f834-4c44-ba42-d2df9d160ab5"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:24.868671 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-074aaafc-651f-464d-bc62-cf7e892a0afc req-9f1d0870-f5b5-4076-ae44-b1840ec01e30 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:24.869161 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-074aaafc-651f-464d-bc62-cf7e892a0afc req-9f1d0870-f5b5-4076-ae44-b1840ec01e30 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:24.869645 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-074aaafc-651f-464d-bc62-cf7e892a0afc req-9f1d0870-f5b5-4076-ae44-b1840ec01e30 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:24.882458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-074aaafc-651f-464d-bc62-cf7e892a0afc req-9f1d0870-f5b5-4076-ae44-b1840ec01e30 service nova] Creating event network-changed:9f61d38a-f834-4c44-ba42-d2df9d160ab5 for instance 64eb4995-d137-42b3-96b4-1af57d704189 on hv-cinder-85426 Aug 24 05:48:24.887874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-074aaafc-651f-464d-bc62-cf7e892a0afc req-9f1d0870-f5b5-4076-ae44-b1840ec01e30 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035125 Aug 24 05:48:24.888535 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 240/478] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:24.934689 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6ded32c7-aa2e-4268-a348-53ab4bc2ef85 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:24.935423 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6ded32c7-aa2e-4268-a348-53ab4bc2ef85 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:24.942792 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ded32c7-aa2e-4268-a348-53ab4bc2ef85 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:24.943276 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ded32c7-aa2e-4268-a348-53ab4bc2ef85 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:24.943709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ded32c7-aa2e-4268-a348-53ab4bc2ef85 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:24.944445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ded32c7-aa2e-4268-a348-53ab4bc2ef85 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:24.944888 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ded32c7-aa2e-4268-a348-53ab4bc2ef85 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:24.945310 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6ded32c7-aa2e-4268-a348-53ab4bc2ef85 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:24.959134 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-896d9787-6272-440f-ae69-0ebc5b260fd3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:24.960138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-896d9787-6272-440f-ae69-0ebc5b260fd3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:24.966891 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-896d9787-6272-440f-ae69-0ebc5b260fd3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:24.967374 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-896d9787-6272-440f-ae69-0ebc5b260fd3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:24.967812 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-896d9787-6272-440f-ae69-0ebc5b260fd3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:24.968750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-896d9787-6272-440f-ae69-0ebc5b260fd3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:24.969784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-896d9787-6272-440f-ae69-0ebc5b260fd3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:24.970370 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-896d9787-6272-440f-ae69-0ebc5b260fd3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:25.044927 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-896d9787-6272-440f-ae69-0ebc5b260fd3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:25.057020 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-896d9787-6272-440f-ae69-0ebc5b260fd3 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.104146 Aug 24 05:48:25.062310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 241/479] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:24 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:25.114448 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6ded32c7-aa2e-4268-a348-53ab4bc2ef85 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:25.123089 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6ded32c7-aa2e-4268-a348-53ab4bc2ef85 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.192268 Aug 24 05:48:25.123657 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 239/480] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:24 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:26.081866 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-218d88f1-ec44-428d-99e4-20f638afbe2c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:26.082651 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-218d88f1-ec44-428d-99e4-20f638afbe2c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:26.089278 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-218d88f1-ec44-428d-99e4-20f638afbe2c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.089772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-218d88f1-ec44-428d-99e4-20f638afbe2c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.090195 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-218d88f1-ec44-428d-99e4-20f638afbe2c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.090889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-218d88f1-ec44-428d-99e4-20f638afbe2c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.091340 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-218d88f1-ec44-428d-99e4-20f638afbe2c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.091764 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-218d88f1-ec44-428d-99e4-20f638afbe2c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.145375 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9b15b515-9bcc-43f5-89d5-905daee37e1c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:26.146170 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9b15b515-9bcc-43f5-89d5-905daee37e1c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:26.157708 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-218d88f1-ec44-428d-99e4-20f638afbe2c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:26.160881 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b15b515-9bcc-43f5-89d5-905daee37e1c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.160881 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b15b515-9bcc-43f5-89d5-905daee37e1c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.160881 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b15b515-9bcc-43f5-89d5-905daee37e1c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.161262 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b15b515-9bcc-43f5-89d5-905daee37e1c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.161937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b15b515-9bcc-43f5-89d5-905daee37e1c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.162435 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b15b515-9bcc-43f5-89d5-905daee37e1c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.165373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-218d88f1-ec44-428d-99e4-20f638afbe2c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.087966 Aug 24 05:48:26.166303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 242/481] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:26 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:26.292390 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9b15b515-9bcc-43f5-89d5-905daee37e1c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:26.300478 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9b15b515-9bcc-43f5-89d5-905daee37e1c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.159875 Aug 24 05:48:26.301150 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 240/482] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:26 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:27.186391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-11fa7b44-3246-46b5-822d-b9c41c079449 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:27.187003 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-11fa7b44-3246-46b5-822d-b9c41c079449 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:27.194253 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11fa7b44-3246-46b5-822d-b9c41c079449 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:27.194729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11fa7b44-3246-46b5-822d-b9c41c079449 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:27.195179 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11fa7b44-3246-46b5-822d-b9c41c079449 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:27.195870 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11fa7b44-3246-46b5-822d-b9c41c079449 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:27.196321 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11fa7b44-3246-46b5-822d-b9c41c079449 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:27.196774 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11fa7b44-3246-46b5-822d-b9c41c079449 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:27.261579 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-11fa7b44-3246-46b5-822d-b9c41c079449 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:27.270257 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-11fa7b44-3246-46b5-822d-b9c41c079449 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.087781 Aug 24 05:48:27.270829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 243/483] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:27 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:27.321322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3d29a0a7-bbae-452d-8020-035c44609526 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:27.321961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3d29a0a7-bbae-452d-8020-035c44609526 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:27.328124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d29a0a7-bbae-452d-8020-035c44609526 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:27.328654 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d29a0a7-bbae-452d-8020-035c44609526 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:27.329097 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d29a0a7-bbae-452d-8020-035c44609526 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:27.330467 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d29a0a7-bbae-452d-8020-035c44609526 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:27.331243 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d29a0a7-bbae-452d-8020-035c44609526 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:27.331755 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3d29a0a7-bbae-452d-8020-035c44609526 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:27.349884 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:27.463087 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3d29a0a7-bbae-452d-8020-035c44609526 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:27.470866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3d29a0a7-bbae-452d-8020-035c44609526 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.153482 Aug 24 05:48:27.474530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 241/484] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:27 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:28.290678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c935d2a0-e70e-4f48-be65-9eb4e83a6c71 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:28.291291 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c935d2a0-e70e-4f48-be65-9eb4e83a6c71 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:28.298207 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c935d2a0-e70e-4f48-be65-9eb4e83a6c71 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:28.298717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c935d2a0-e70e-4f48-be65-9eb4e83a6c71 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:28.299470 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c935d2a0-e70e-4f48-be65-9eb4e83a6c71 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:28.300257 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c935d2a0-e70e-4f48-be65-9eb4e83a6c71 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:28.300779 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c935d2a0-e70e-4f48-be65-9eb4e83a6c71 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:28.301212 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c935d2a0-e70e-4f48-be65-9eb4e83a6c71 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:28.364649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c935d2a0-e70e-4f48-be65-9eb4e83a6c71 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:28.372315 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c935d2a0-e70e-4f48-be65-9eb4e83a6c71 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.085504 Aug 24 05:48:28.372927 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 244/485] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:28 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:28.491666 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2baeedd3-865d-42bb-8bce-c6cf2c894307 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:28.492182 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2baeedd3-865d-42bb-8bce-c6cf2c894307 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:28.498195 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2baeedd3-865d-42bb-8bce-c6cf2c894307 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:28.498678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2baeedd3-865d-42bb-8bce-c6cf2c894307 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:28.499119 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2baeedd3-865d-42bb-8bce-c6cf2c894307 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:28.499857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2baeedd3-865d-42bb-8bce-c6cf2c894307 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:28.500326 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2baeedd3-865d-42bb-8bce-c6cf2c894307 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:28.500786 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2baeedd3-865d-42bb-8bce-c6cf2c894307 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:28.635552 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2baeedd3-865d-42bb-8bce-c6cf2c894307 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:28.643936 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2baeedd3-865d-42bb-8bce-c6cf2c894307 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.156202 Aug 24 05:48:28.644553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 242/486] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:28 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:29.393322 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fa3471d2-cd86-4842-8492-3d3880427745 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:29.393945 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-fa3471d2-cd86-4842-8492-3d3880427745 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:29.401026 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa3471d2-cd86-4842-8492-3d3880427745 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:29.401538 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa3471d2-cd86-4842-8492-3d3880427745 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:29.401976 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa3471d2-cd86-4842-8492-3d3880427745 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:29.402680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa3471d2-cd86-4842-8492-3d3880427745 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:29.403164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa3471d2-cd86-4842-8492-3d3880427745 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:29.403591 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fa3471d2-cd86-4842-8492-3d3880427745 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:29.469347 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-fa3471d2-cd86-4842-8492-3d3880427745 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:29.478241 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-fa3471d2-cd86-4842-8492-3d3880427745 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1266 microversion: 2.1 time: 0.088748 Aug 24 05:48:29.478807 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 245/487] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:29 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:29.664787 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-91fa1d4d-90a8-4435-9975-683e225b9b86 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:29.665445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-91fa1d4d-90a8-4435-9975-683e225b9b86 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:29.673297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-91fa1d4d-90a8-4435-9975-683e225b9b86 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:29.674684 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-91fa1d4d-90a8-4435-9975-683e225b9b86 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:29.675146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-91fa1d4d-90a8-4435-9975-683e225b9b86 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:29.676188 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-91fa1d4d-90a8-4435-9975-683e225b9b86 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:29.676729 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-91fa1d4d-90a8-4435-9975-683e225b9b86 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:29.677160 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-91fa1d4d-90a8-4435-9975-683e225b9b86 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:29.818529 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-91fa1d4d-90a8-4435-9975-683e225b9b86 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:29.826402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-91fa1d4d-90a8-4435-9975-683e225b9b86 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.165559 Aug 24 05:48:29.826971 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 243/488] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:29 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:30.499139 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ab27bef6-320c-458f-9970-bda9df9def34 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:30.499761 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ab27bef6-320c-458f-9970-bda9df9def34 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:30.507914 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab27bef6-320c-458f-9970-bda9df9def34 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:30.508453 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab27bef6-320c-458f-9970-bda9df9def34 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:30.509551 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab27bef6-320c-458f-9970-bda9df9def34 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:30.510298 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab27bef6-320c-458f-9970-bda9df9def34 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:30.510917 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab27bef6-320c-458f-9970-bda9df9def34 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:30.511368 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab27bef6-320c-458f-9970-bda9df9def34 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:30.580853 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ab27bef6-320c-458f-9970-bda9df9def34 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:30.588029 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ab27bef6-320c-458f-9970-bda9df9def34 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1274 microversion: 2.1 time: 0.092428 Aug 24 05:48:30.588676 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 246/489] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:30 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:30.877775 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f25d750a-a5d7-4fc4-a8b1-a3cce8a0c5b1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:30.877775 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f25d750a-a5d7-4fc4-a8b1-a3cce8a0c5b1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:30.877775 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f25d750a-a5d7-4fc4-a8b1-a3cce8a0c5b1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:30.877775 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f25d750a-a5d7-4fc4-a8b1-a3cce8a0c5b1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:30.878709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f25d750a-a5d7-4fc4-a8b1-a3cce8a0c5b1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:30.878709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f25d750a-a5d7-4fc4-a8b1-a3cce8a0c5b1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:30.878709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f25d750a-a5d7-4fc4-a8b1-a3cce8a0c5b1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:30.878709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f25d750a-a5d7-4fc4-a8b1-a3cce8a0c5b1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:31.032680 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f25d750a-a5d7-4fc4-a8b1-a3cce8a0c5b1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:31.041801 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f25d750a-a5d7-4fc4-a8b1-a3cce8a0c5b1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.197042 Aug 24 05:48:31.042549 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 244/490] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:30 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:31.610388 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5c4c601e-5c40-4b0e-a812-78f46a000579 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:31.611940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5c4c601e-5c40-4b0e-a812-78f46a000579 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:31.620760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c4c601e-5c40-4b0e-a812-78f46a000579 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:31.620760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c4c601e-5c40-4b0e-a812-78f46a000579 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:31.620760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c4c601e-5c40-4b0e-a812-78f46a000579 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:31.620760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c4c601e-5c40-4b0e-a812-78f46a000579 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:31.621196 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c4c601e-5c40-4b0e-a812-78f46a000579 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:31.621196 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c4c601e-5c40-4b0e-a812-78f46a000579 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:31.689273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5c4c601e-5c40-4b0e-a812-78f46a000579 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:31.697282 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5c4c601e-5c40-4b0e-a812-78f46a000579 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1272 microversion: 2.1 time: 0.090908 Aug 24 05:48:31.697854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 247/491] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:31 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:32.063360 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-29a9c94a-b495-4fef-b8a0-9a851a84b7e3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:32.070182 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-29a9c94a-b495-4fef-b8a0-9a851a84b7e3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:32.070762 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-29a9c94a-b495-4fef-b8a0-9a851a84b7e3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:32.071280 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-29a9c94a-b495-4fef-b8a0-9a851a84b7e3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:32.071718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-29a9c94a-b495-4fef-b8a0-9a851a84b7e3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:32.072439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-29a9c94a-b495-4fef-b8a0-9a851a84b7e3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:32.073173 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-29a9c94a-b495-4fef-b8a0-9a851a84b7e3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:32.073498 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-29a9c94a-b495-4fef-b8a0-9a851a84b7e3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:32.212455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-29a9c94a-b495-4fef-b8a0-9a851a84b7e3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:32.221389 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-29a9c94a-b495-4fef-b8a0-9a851a84b7e3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.162020 Aug 24 05:48:32.221982 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 245/492] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:32 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:32.722752 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-dbd33b8c-d259-4f42-b1bc-ce8835b42ff0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:32.724247 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-dbd33b8c-d259-4f42-b1bc-ce8835b42ff0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:32.731767 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbd33b8c-d259-4f42-b1bc-ce8835b42ff0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:32.732658 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbd33b8c-d259-4f42-b1bc-ce8835b42ff0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:32.733257 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbd33b8c-d259-4f42-b1bc-ce8835b42ff0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:32.734352 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbd33b8c-d259-4f42-b1bc-ce8835b42ff0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:32.735150 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbd33b8c-d259-4f42-b1bc-ce8835b42ff0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:32.737317 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dbd33b8c-d259-4f42-b1bc-ce8835b42ff0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:32.922602 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dbd33b8c-d259-4f42-b1bc-ce8835b42ff0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:32.934986 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-dbd33b8c-d259-4f42-b1bc-ce8835b42ff0 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.218513 Aug 24 05:48:32.936186 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 248/493] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:32 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:33.147791 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-77488177-7a15-4709-85eb-769fad0e4f61 req-891a3eea-ca63-4489-94d9-b1e04f822bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be90cc32-6bea-4a9f-99b6-c47cdbeea246", "name": "network-vif-plugged", "status": "completed", "tag": "5aeffe0a-e1d3-441b-86b9-7b72a10a2baa"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:33.165459 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-77488177-7a15-4709-85eb-769fad0e4f61 req-891a3eea-ca63-4489-94d9-b1e04f822bc6 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:33.166034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-77488177-7a15-4709-85eb-769fad0e4f61 req-891a3eea-ca63-4489-94d9-b1e04f822bc6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:33.166475 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-77488177-7a15-4709-85eb-769fad0e4f61 req-891a3eea-ca63-4489-94d9-b1e04f822bc6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:33.182433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-77488177-7a15-4709-85eb-769fad0e4f61 req-891a3eea-ca63-4489-94d9-b1e04f822bc6 service nova] Creating event network-vif-plugged:5aeffe0a-e1d3-441b-86b9-7b72a10a2baa for instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 on hv-cinder-85426 Aug 24 05:48:33.189173 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-77488177-7a15-4709-85eb-769fad0e4f61 req-891a3eea-ca63-4489-94d9-b1e04f822bc6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048030 Aug 24 05:48:33.190117 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 246/494] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:33.243078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4d982b1b-9955-45da-856f-6d72cd185ac5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:33.243693 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4d982b1b-9955-45da-856f-6d72cd185ac5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:33.249882 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d982b1b-9955-45da-856f-6d72cd185ac5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:33.250382 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d982b1b-9955-45da-856f-6d72cd185ac5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:33.250823 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d982b1b-9955-45da-856f-6d72cd185ac5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:33.251769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d982b1b-9955-45da-856f-6d72cd185ac5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:33.252784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d982b1b-9955-45da-856f-6d72cd185ac5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:33.253346 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d982b1b-9955-45da-856f-6d72cd185ac5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:33.404044 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4d982b1b-9955-45da-856f-6d72cd185ac5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:33.413164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4d982b1b-9955-45da-856f-6d72cd185ac5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.173789 Aug 24 05:48:33.414004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 249/495] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:33 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:33.763990 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-dc66e178-ab57-4c3f-bc33-2dd0e46b68fc req-01c13ae0-e865-4078-9995-fef671a876f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eae302d-22b2-4682-954f-a617fecc4f9a", "tag": "dcd0af8e-af59-4ad6-a5b8-f8133e41a73f"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:33.775128 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-dc66e178-ab57-4c3f-bc33-2dd0e46b68fc req-01c13ae0-e865-4078-9995-fef671a876f8 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:33.775812 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-dc66e178-ab57-4c3f-bc33-2dd0e46b68fc req-01c13ae0-e865-4078-9995-fef671a876f8 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:33.776255 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-dc66e178-ab57-4c3f-bc33-2dd0e46b68fc req-01c13ae0-e865-4078-9995-fef671a876f8 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:33.787976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-dc66e178-ab57-4c3f-bc33-2dd0e46b68fc req-01c13ae0-e865-4078-9995-fef671a876f8 service nova] Creating event network-changed:dcd0af8e-af59-4ad6-a5b8-f8133e41a73f for instance 4eae302d-22b2-4682-954f-a617fecc4f9a on hv-cinder-85426 Aug 24 05:48:33.793624 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-dc66e178-ab57-4c3f-bc33-2dd0e46b68fc req-01c13ae0-e865-4078-9995-fef671a876f8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036289 Aug 24 05:48:33.797070 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 247/496] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:48:33.966535 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ac155dc5-c55b-47c7-9b6c-2204c87f0198 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:33.967650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ac155dc5-c55b-47c7-9b6c-2204c87f0198 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:33.974673 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ac155dc5-c55b-47c7-9b6c-2204c87f0198 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:33.975106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ac155dc5-c55b-47c7-9b6c-2204c87f0198 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:33.975510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ac155dc5-c55b-47c7-9b6c-2204c87f0198 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:33.976169 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ac155dc5-c55b-47c7-9b6c-2204c87f0198 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:33.977171 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ac155dc5-c55b-47c7-9b6c-2204c87f0198 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:33.977625 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ac155dc5-c55b-47c7-9b6c-2204c87f0198 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:34.123082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ac155dc5-c55b-47c7-9b6c-2204c87f0198 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:34.131279 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ac155dc5-c55b-47c7-9b6c-2204c87f0198 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.168607 Aug 24 05:48:34.131852 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 250/497] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:33 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:34.434511 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b62a9175-50dc-45da-87d5-71f2b472c873 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:34.437950 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b62a9175-50dc-45da-87d5-71f2b472c873 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:34.443057 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b62a9175-50dc-45da-87d5-71f2b472c873 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:34.444007 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b62a9175-50dc-45da-87d5-71f2b472c873 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:34.444646 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b62a9175-50dc-45da-87d5-71f2b472c873 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:34.445542 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b62a9175-50dc-45da-87d5-71f2b472c873 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:34.446167 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b62a9175-50dc-45da-87d5-71f2b472c873 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:34.446783 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b62a9175-50dc-45da-87d5-71f2b472c873 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:34.682427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b62a9175-50dc-45da-87d5-71f2b472c873 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:34.690674 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b62a9175-50dc-45da-87d5-71f2b472c873 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.260586 Aug 24 05:48:34.691282 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 248/498] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:34 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:35.152373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-33ea80d3-4c66-4541-9a78-1fcf09dcc858 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:35.153065 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-33ea80d3-4c66-4541-9a78-1fcf09dcc858 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:35.160796 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33ea80d3-4c66-4541-9a78-1fcf09dcc858 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:35.164095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33ea80d3-4c66-4541-9a78-1fcf09dcc858 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:35.164095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33ea80d3-4c66-4541-9a78-1fcf09dcc858 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:35.164095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33ea80d3-4c66-4541-9a78-1fcf09dcc858 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:35.164095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33ea80d3-4c66-4541-9a78-1fcf09dcc858 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:35.164551 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33ea80d3-4c66-4541-9a78-1fcf09dcc858 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:35.369972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-33ea80d3-4c66-4541-9a78-1fcf09dcc858 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:35.379458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-33ea80d3-4c66-4541-9a78-1fcf09dcc858 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.231393 Aug 24 05:48:35.379969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 251/499] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:35 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:35.712718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0fa88a95-0aec-43f7-8f7d-a8df4e67418b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:35.713437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0fa88a95-0aec-43f7-8f7d-a8df4e67418b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:35.728023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0fa88a95-0aec-43f7-8f7d-a8df4e67418b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:35.729915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0fa88a95-0aec-43f7-8f7d-a8df4e67418b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:35.730391 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0fa88a95-0aec-43f7-8f7d-a8df4e67418b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:35.731128 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0fa88a95-0aec-43f7-8f7d-a8df4e67418b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:35.731626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0fa88a95-0aec-43f7-8f7d-a8df4e67418b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:35.732075 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0fa88a95-0aec-43f7-8f7d-a8df4e67418b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:35.915268 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0fa88a95-0aec-43f7-8f7d-a8df4e67418b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:35.923701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0fa88a95-0aec-43f7-8f7d-a8df4e67418b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1357 microversion: 2.1 time: 0.215682 Aug 24 05:48:35.924262 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 249/500] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:35 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:36.400253 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-62aa7c5b-097f-47f7-a35f-837641bbc684 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:36.400895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-62aa7c5b-097f-47f7-a35f-837641bbc684 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:36.408698 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-62aa7c5b-097f-47f7-a35f-837641bbc684 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:36.409200 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-62aa7c5b-097f-47f7-a35f-837641bbc684 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:36.409637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-62aa7c5b-097f-47f7-a35f-837641bbc684 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:36.410351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-62aa7c5b-097f-47f7-a35f-837641bbc684 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:36.410808 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-62aa7c5b-097f-47f7-a35f-837641bbc684 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:36.411236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-62aa7c5b-097f-47f7-a35f-837641bbc684 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:36.561438 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-62aa7c5b-097f-47f7-a35f-837641bbc684 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:36.569407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-62aa7c5b-097f-47f7-a35f-837641bbc684 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.172960 Aug 24 05:48:36.569984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 252/501] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:36 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:36.945098 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9313e629-f694-4081-953f-a5d1869893e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:36.945714 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9313e629-f694-4081-953f-a5d1869893e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:36.951776 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9313e629-f694-4081-953f-a5d1869893e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:36.952255 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9313e629-f694-4081-953f-a5d1869893e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:36.952745 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9313e629-f694-4081-953f-a5d1869893e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:36.953976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9313e629-f694-4081-953f-a5d1869893e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:36.955133 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9313e629-f694-4081-953f-a5d1869893e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:36.955647 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9313e629-f694-4081-953f-a5d1869893e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.112228 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9313e629-f694-4081-953f-a5d1869893e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:37.135993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9313e629-f694-4081-953f-a5d1869893e9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1546 microversion: 2.1 time: 0.179233 Aug 24 05:48:37.135993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 250/502] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:36 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:37.153162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f1f010f8-2253-46af-a0f9-556c311e9d4f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:37.153845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f1f010f8-2253-46af-a0f9-556c311e9d4f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:37.160153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1f010f8-2253-46af-a0f9-556c311e9d4f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:37.160667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1f010f8-2253-46af-a0f9-556c311e9d4f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:37.161094 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1f010f8-2253-46af-a0f9-556c311e9d4f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.161782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1f010f8-2253-46af-a0f9-556c311e9d4f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:37.162260 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1f010f8-2253-46af-a0f9-556c311e9d4f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:37.162655 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1f010f8-2253-46af-a0f9-556c311e9d4f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.321818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f1f010f8-2253-46af-a0f9-556c311e9d4f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:37.330301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f1f010f8-2253-46af-a0f9-556c311e9d4f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1546 microversion: 2.1 time: 0.181569 Aug 24 05:48:37.330999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 253/503] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:37 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1546 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:37.350112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9fd901b2-404e-4c14-a4d7-d9f8c58b35d7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:37.355087 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9fd901b2-404e-4c14-a4d7-d9f8c58b35d7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:37.355933 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9fd901b2-404e-4c14-a4d7-d9f8c58b35d7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Searching by: {'deleted': False, 'project_id': 'de8b104cdda04729a55a5af9d4503c81'} {{(pid=127755) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 05:48:37.364281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd901b2-404e-4c14-a4d7-d9f8c58b35d7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:37.364879 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd901b2-404e-4c14-a4d7-d9f8c58b35d7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:37.365418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd901b2-404e-4c14-a4d7-d9f8c58b35d7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.366212 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd901b2-404e-4c14-a4d7-d9f8c58b35d7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:37.366740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd901b2-404e-4c14-a4d7-d9f8c58b35d7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:37.367236 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd901b2-404e-4c14-a4d7-d9f8c58b35d7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.460837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.multi_cell_list [None req-9fd901b2-404e-4c14-a4d7-d9f8c58b35d7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127755) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 05:48:37.559807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9fd901b2-404e-4c14-a4d7-d9f8c58b35d7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213577 Aug 24 05:48:37.560391 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 251/504] 10.222.0.15 () {58 vars in 1125 bytes} [Wed Aug 24 05:48:37 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:37.572719 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-cd7f06d3-27a8-497a-aa3e-f4a167ff8f71 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:37.577053 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-cd7f06d3-27a8-497a-aa3e-f4a167ff8f71 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:37.581269 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd7f06d3-27a8-497a-aa3e-f4a167ff8f71 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:37.581844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd7f06d3-27a8-497a-aa3e-f4a167ff8f71 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:37.582294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd7f06d3-27a8-497a-aa3e-f4a167ff8f71 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.583002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd7f06d3-27a8-497a-aa3e-f4a167ff8f71 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:37.583460 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd7f06d3-27a8-497a-aa3e-f4a167ff8f71 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:37.584047 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd7f06d3-27a8-497a-aa3e-f4a167ff8f71 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.589865 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7dc495ab-04cd-4469-96d2-b1476c54481c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:37.590490 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7dc495ab-04cd-4469-96d2-b1476c54481c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:37.601487 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dc495ab-04cd-4469-96d2-b1476c54481c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:37.601987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dc495ab-04cd-4469-96d2-b1476c54481c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:37.608463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dc495ab-04cd-4469-96d2-b1476c54481c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.608708 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dc495ab-04cd-4469-96d2-b1476c54481c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:37.609172 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dc495ab-04cd-4469-96d2-b1476c54481c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:37.609652 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7dc495ab-04cd-4469-96d2-b1476c54481c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.829035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cd7f06d3-27a8-497a-aa3e-f4a167ff8f71 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:37.839871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-cd7f06d3-27a8-497a-aa3e-f4a167ff8f71 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1546 microversion: 2.1 time: 0.271403 Aug 24 05:48:37.849564 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 254/505] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:37 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1546 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:37.849851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7dc495ab-04cd-4469-96d2-b1476c54481c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:37.853413 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7dc495ab-04cd-4469-96d2-b1476c54481c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.267259 Aug 24 05:48:37.862853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 252/506] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:37 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:38.876064 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4bd14839-2293-4767-8939-d6a71986f141 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:38.876847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4bd14839-2293-4767-8939-d6a71986f141 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:38.902424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bd14839-2293-4767-8939-d6a71986f141 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:38.903159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bd14839-2293-4767-8939-d6a71986f141 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:38.903711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bd14839-2293-4767-8939-d6a71986f141 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:38.904554 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bd14839-2293-4767-8939-d6a71986f141 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:38.905123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bd14839-2293-4767-8939-d6a71986f141 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:38.905668 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4bd14839-2293-4767-8939-d6a71986f141 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:39.109018 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4bd14839-2293-4767-8939-d6a71986f141 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:39.118051 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4bd14839-2293-4767-8939-d6a71986f141 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.246467 Aug 24 05:48:39.118635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 255/507] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:38 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:40.139632 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6cd8bf27-618d-433c-9efa-0ccd425320cb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:40.140250 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6cd8bf27-618d-433c-9efa-0ccd425320cb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:40.146477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cd8bf27-618d-433c-9efa-0ccd425320cb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:40.146975 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cd8bf27-618d-433c-9efa-0ccd425320cb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:40.148105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cd8bf27-618d-433c-9efa-0ccd425320cb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:40.148105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cd8bf27-618d-433c-9efa-0ccd425320cb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:40.148637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cd8bf27-618d-433c-9efa-0ccd425320cb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:40.153803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cd8bf27-618d-433c-9efa-0ccd425320cb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:40.416806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6cd8bf27-618d-433c-9efa-0ccd425320cb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:40.431031 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6cd8bf27-618d-433c-9efa-0ccd425320cb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.293808 Aug 24 05:48:40.431031 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 253/508] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:40 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:41.200106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6f524637-98ab-473a-867c-864fa568d942 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "862ec37c-9893-4185-85a7-36edc61685f3"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:41.202688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6f524637-98ab-473a-867c-864fa568d942 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:41.210802 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f524637-98ab-473a-867c-864fa568d942 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:41.211297 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f524637-98ab-473a-867c-864fa568d942 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:41.212027 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f524637-98ab-473a-867c-864fa568d942 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:41.212550 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f524637-98ab-473a-867c-864fa568d942 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:41.213015 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f524637-98ab-473a-867c-864fa568d942 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:41.213441 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f524637-98ab-473a-867c-864fa568d942 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:41.452930 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e8f33293-33f6-480b-a99f-be36875c504c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:41.453676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e8f33293-33f6-480b-a99f-be36875c504c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:41.461519 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e8f33293-33f6-480b-a99f-be36875c504c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:41.462015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e8f33293-33f6-480b-a99f-be36875c504c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:41.462445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e8f33293-33f6-480b-a99f-be36875c504c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:41.463374 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e8f33293-33f6-480b-a99f-be36875c504c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:41.463999 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e8f33293-33f6-480b-a99f-be36875c504c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:41.464657 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e8f33293-33f6-480b-a99f-be36875c504c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:41.524349 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:41.789263 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e8f33293-33f6-480b-a99f-be36875c504c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:41.798475 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e8f33293-33f6-480b-a99f-be36875c504c tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.349902 Aug 24 05:48:41.799733 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 254/509] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:41 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:42.399646 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6f524637-98ab-473a-867c-864fa568d942 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "POST /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.204744 Aug 24 05:48:42.400303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 256/510] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 05:48:41 2022] POST /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments => generated 194 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:42.823419 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-823592ff-950d-4bf1-ba57-ee803eabb941 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:42.824728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-823592ff-950d-4bf1-ba57-ee803eabb941 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:42.833013 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-823592ff-950d-4bf1-ba57-ee803eabb941 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:42.833789 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-823592ff-950d-4bf1-ba57-ee803eabb941 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:42.834703 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-823592ff-950d-4bf1-ba57-ee803eabb941 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:42.835653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-823592ff-950d-4bf1-ba57-ee803eabb941 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:42.836146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-823592ff-950d-4bf1-ba57-ee803eabb941 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:42.836775 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-823592ff-950d-4bf1-ba57-ee803eabb941 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:42.981948 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-823592ff-950d-4bf1-ba57-ee803eabb941 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:42.990565 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-823592ff-950d-4bf1-ba57-ee803eabb941 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.172472 Aug 24 05:48:42.991241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 255/511] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:42 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:44.012487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7dda9e8f-ce0c-4095-acc5-e85727cf10a6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:44.013189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7dda9e8f-ce0c-4095-acc5-e85727cf10a6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:44.019669 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dda9e8f-ce0c-4095-acc5-e85727cf10a6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:44.020162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dda9e8f-ce0c-4095-acc5-e85727cf10a6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:44.020623 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dda9e8f-ce0c-4095-acc5-e85727cf10a6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:44.021336 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dda9e8f-ce0c-4095-acc5-e85727cf10a6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:44.021853 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dda9e8f-ce0c-4095-acc5-e85727cf10a6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:44.022280 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dda9e8f-ce0c-4095-acc5-e85727cf10a6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:44.161428 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-27e20659-68c4-49f6-8eee-55eb325f9f43 req-1469e64b-da18-44f9-80d6-238c2d6a6335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eae302d-22b2-4682-954f-a617fecc4f9a", "name": "network-vif-plugged", "status": "completed", "tag": "dcd0af8e-af59-4ad6-a5b8-f8133e41a73f"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:44.175591 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7dda9e8f-ce0c-4095-acc5-e85727cf10a6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:44.180524 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-27e20659-68c4-49f6-8eee-55eb325f9f43 req-1469e64b-da18-44f9-80d6-238c2d6a6335 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:44.181385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-27e20659-68c4-49f6-8eee-55eb325f9f43 req-1469e64b-da18-44f9-80d6-238c2d6a6335 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:44.181937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-27e20659-68c4-49f6-8eee-55eb325f9f43 req-1469e64b-da18-44f9-80d6-238c2d6a6335 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:44.201940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7dda9e8f-ce0c-4095-acc5-e85727cf10a6 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.194208 Aug 24 05:48:44.211988 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 257/512] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:44 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:44.219297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-27e20659-68c4-49f6-8eee-55eb325f9f43 req-1469e64b-da18-44f9-80d6-238c2d6a6335 service nova] Creating event network-vif-plugged:dcd0af8e-af59-4ad6-a5b8-f8133e41a73f for instance 4eae302d-22b2-4682-954f-a617fecc4f9a on hv-cinder-85426 Aug 24 05:48:44.227507 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-27e20659-68c4-49f6-8eee-55eb325f9f43 req-1469e64b-da18-44f9-80d6-238c2d6a6335 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069755 Aug 24 05:48:44.228526 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 256/513] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:48:45.223801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e1b61ab0-0232-4543-b88c-cf3038ef6945 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:45.224445 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e1b61ab0-0232-4543-b88c-cf3038ef6945 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:45.233465 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b61ab0-0232-4543-b88c-cf3038ef6945 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:45.233465 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b61ab0-0232-4543-b88c-cf3038ef6945 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:45.233736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b61ab0-0232-4543-b88c-cf3038ef6945 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:45.234482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b61ab0-0232-4543-b88c-cf3038ef6945 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:45.235109 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b61ab0-0232-4543-b88c-cf3038ef6945 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:45.235552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e1b61ab0-0232-4543-b88c-cf3038ef6945 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:45.382223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e1b61ab0-0232-4543-b88c-cf3038ef6945 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:45.391513 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e1b61ab0-0232-4543-b88c-cf3038ef6945 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.172041 Aug 24 05:48:45.392084 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 258/514] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:45 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:46.414738 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-abdac673-3263-4e82-9d28-29753ea9619e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:46.415658 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-abdac673-3263-4e82-9d28-29753ea9619e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:46.422380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-abdac673-3263-4e82-9d28-29753ea9619e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:46.423006 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-abdac673-3263-4e82-9d28-29753ea9619e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:46.423560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-abdac673-3263-4e82-9d28-29753ea9619e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:46.424500 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-abdac673-3263-4e82-9d28-29753ea9619e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:46.425089 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-abdac673-3263-4e82-9d28-29753ea9619e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:46.426253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-abdac673-3263-4e82-9d28-29753ea9619e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:46.581278 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-abdac673-3263-4e82-9d28-29753ea9619e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:46.591956 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-abdac673-3263-4e82-9d28-29753ea9619e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1314 microversion: 2.1 time: 0.182134 Aug 24 05:48:46.592581 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 257/515] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:46 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:47.622332 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1138c988-42b5-4c32-8172-273073f8382b tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:47.623076 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1138c988-42b5-4c32-8172-273073f8382b tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:47.631507 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=62 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:47.634180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1138c988-42b5-4c32-8172-273073f8382b tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:47.635174 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1138c988-42b5-4c32-8172-273073f8382b tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:47.636075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1138c988-42b5-4c32-8172-273073f8382b tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:47.638715 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1138c988-42b5-4c32-8172-273073f8382b tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:47.639589 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1138c988-42b5-4c32-8172-273073f8382b tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:47.640250 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1138c988-42b5-4c32-8172-273073f8382b tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:47.946372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1138c988-42b5-4c32-8172-273073f8382b tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:47.955491 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1138c988-42b5-4c32-8172-273073f8382b tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1463 microversion: 2.1 time: 0.345871 Aug 24 05:48:47.956965 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 259/516] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:47 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1463 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:48.029595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8e5bc946-d350-412a-a92f-02ee5c181c43 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:48.030148 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8e5bc946-d350-412a-a92f-02ee5c181c43 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:48.036217 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:48.038341 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e5bc946-d350-412a-a92f-02ee5c181c43 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:48.039029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e5bc946-d350-412a-a92f-02ee5c181c43 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:48.039639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e5bc946-d350-412a-a92f-02ee5c181c43 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:48.040695 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e5bc946-d350-412a-a92f-02ee5c181c43 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:48.041513 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e5bc946-d350-412a-a92f-02ee5c181c43 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:48.042113 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e5bc946-d350-412a-a92f-02ee5c181c43 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:48.079316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8e5bc946-d350-412a-a92f-02ee5c181c43 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:48:48.123597 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:48.449581 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8e5bc946-d350-412a-a92f-02ee5c181c43 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 204 len: 0 microversion: 2.1 time: 0.424748 Aug 24 05:48:48.450186 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 258/517] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:48:48 2022] DELETE /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:48:48.461065 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6ee64ded-f310-4fd8-9765-234c73e332eb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:48.461876 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6ee64ded-f310-4fd8-9765-234c73e332eb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:48.468811 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6ee64ded-f310-4fd8-9765-234c73e332eb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:48.469415 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6ee64ded-f310-4fd8-9765-234c73e332eb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:48.469953 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6ee64ded-f310-4fd8-9765-234c73e332eb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:48.470897 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6ee64ded-f310-4fd8-9765-234c73e332eb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:48.471438 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6ee64ded-f310-4fd8-9765-234c73e332eb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:48.477088 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6ee64ded-f310-4fd8-9765-234c73e332eb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:48.730117 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6ee64ded-f310-4fd8-9765-234c73e332eb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:48.741018 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6ee64ded-f310-4fd8-9765-234c73e332eb tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1469 microversion: 2.1 time: 0.286168 Aug 24 05:48:48.769296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 260/518] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:48 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1469 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:49.791493 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a8ae6757-090e-4c98-ab2c-86f3fc081801 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:49.792420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a8ae6757-090e-4c98-ab2c-86f3fc081801 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:49.802894 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8ae6757-090e-4c98-ab2c-86f3fc081801 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:49.803517 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8ae6757-090e-4c98-ab2c-86f3fc081801 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:49.803965 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8ae6757-090e-4c98-ab2c-86f3fc081801 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:49.804754 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8ae6757-090e-4c98-ab2c-86f3fc081801 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:49.805254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8ae6757-090e-4c98-ab2c-86f3fc081801 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:49.805734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8ae6757-090e-4c98-ab2c-86f3fc081801 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:50.014759 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a8ae6757-090e-4c98-ab2c-86f3fc081801 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:50.024834 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a8ae6757-090e-4c98-ab2c-86f3fc081801 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1469 microversion: 2.1 time: 0.260962 Aug 24 05:48:50.026047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 259/519] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:49 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1469 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:50.069866 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-eb4463c7-1d81-41a5-83d3-fcf6666877e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:50.070411 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-eb4463c7-1d81-41a5-83d3-fcf6666877e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:50.077882 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb4463c7-1d81-41a5-83d3-fcf6666877e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:50.078370 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb4463c7-1d81-41a5-83d3-fcf6666877e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:50.078804 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb4463c7-1d81-41a5-83d3-fcf6666877e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:50.079503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb4463c7-1d81-41a5-83d3-fcf6666877e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:50.079956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb4463c7-1d81-41a5-83d3-fcf6666877e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:50.080382 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb4463c7-1d81-41a5-83d3-fcf6666877e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:50.106761 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-eb4463c7-1d81-41a5-83d3-fcf6666877e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/ips" status: 200 len: 150 microversion: 2.1 time: 0.041071 Aug 24 05:48:50.109027 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 261/520] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 24 05:48:50 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:51.047840 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-925eb17c-a839-4c0f-ba86-8ae72bd2194d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:51.048486 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-925eb17c-a839-4c0f-ba86-8ae72bd2194d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:51.051504 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:51.056490 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-925eb17c-a839-4c0f-ba86-8ae72bd2194d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:51.057008 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-925eb17c-a839-4c0f-ba86-8ae72bd2194d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:51.057448 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-925eb17c-a839-4c0f-ba86-8ae72bd2194d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:51.058148 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-925eb17c-a839-4c0f-ba86-8ae72bd2194d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:51.058607 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-925eb17c-a839-4c0f-ba86-8ae72bd2194d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:51.059036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-925eb17c-a839-4c0f-ba86-8ae72bd2194d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:51.223034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-925eb17c-a839-4c0f-ba86-8ae72bd2194d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:51.232133 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-925eb17c-a839-4c0f-ba86-8ae72bd2194d tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1469 microversion: 2.1 time: 0.188736 Aug 24 05:48:51.232768 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 260/521] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:51 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:52.266055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-811f400b-605a-46bc-8074-ffec5ac44586 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:52.266055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-811f400b-605a-46bc-8074-ffec5ac44586 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:52.266055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-811f400b-605a-46bc-8074-ffec5ac44586 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:52.266055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-811f400b-605a-46bc-8074-ffec5ac44586 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:52.272708 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-811f400b-605a-46bc-8074-ffec5ac44586 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:52.274716 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-811f400b-605a-46bc-8074-ffec5ac44586 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:52.279429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-811f400b-605a-46bc-8074-ffec5ac44586 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:52.286358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-811f400b-605a-46bc-8074-ffec5ac44586 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:52.612566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-811f400b-605a-46bc-8074-ffec5ac44586 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:52.632852 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-811f400b-605a-46bc-8074-ffec5ac44586 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1469 microversion: 2.1 time: 0.381553 Aug 24 05:48:52.648539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 262/522] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:52 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1469 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:52.957687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-b92e4d47-df04-47e8-a890-51199bfc9d52 req-51b855bd-a744-4793-b855-fbb57f87c4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eae302d-22b2-4682-954f-a617fecc4f9a", "name": "network-vif-deleted", "tag": "dcd0af8e-af59-4ad6-a5b8-f8133e41a73f"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:52.967851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-b92e4d47-df04-47e8-a890-51199bfc9d52 req-51b855bd-a744-4793-b855-fbb57f87c4c1 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:52.974479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-b92e4d47-df04-47e8-a890-51199bfc9d52 req-51b855bd-a744-4793-b855-fbb57f87c4c1 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:52.975204 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-b92e4d47-df04-47e8-a890-51199bfc9d52 req-51b855bd-a744-4793-b855-fbb57f87c4c1 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:53.001898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-b92e4d47-df04-47e8-a890-51199bfc9d52 req-51b855bd-a744-4793-b855-fbb57f87c4c1 service nova] Creating event network-vif-deleted:dcd0af8e-af59-4ad6-a5b8-f8133e41a73f for instance 4eae302d-22b2-4682-954f-a617fecc4f9a on hv-cinder-85426 Aug 24 05:48:53.010184 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-b92e4d47-df04-47e8-a890-51199bfc9d52 req-51b855bd-a744-4793-b855-fbb57f87c4c1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057218 Aug 24 05:48:53.011349 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 261/523] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:53.104194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-042a4d12-2456-45cf-8ad0-9a56efe05b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e96c29e-a64c-4087-9ab1-2b8146b1fb76"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:53.107523 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-042a4d12-2456-45cf-8ad0-9a56efe05b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:53.115548 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042a4d12-2456-45cf-8ad0-9a56efe05b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:53.116291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042a4d12-2456-45cf-8ad0-9a56efe05b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:53.117362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042a4d12-2456-45cf-8ad0-9a56efe05b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:53.118255 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042a4d12-2456-45cf-8ad0-9a56efe05b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:53.118717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042a4d12-2456-45cf-8ad0-9a56efe05b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:53.119377 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-042a4d12-2456-45cf-8ad0-9a56efe05b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:53.249500 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-86ac148a-478b-4ffb-bb8e-3f8f4ce4f841 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Action: 'create', calling method: .version_select at 0x7f065c184790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1642854592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7wJ39ZK+zW4Vzve17+I8sY0gPRAgXN+l9FHn96aixRT18iird9a2AW5qWOh/S0kA8Vl5orBZfXJv2j1Y5LOMWNSH33ygrlq2/9pNS6vdy8QJ/S6Z5GEAmCiuBFrDdC6g=="}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:53.266816 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-86ac148a-478b-4ffb-bb8e-3f8f4ce4f841 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Getting quotas for project 8e8dbc250d3447ecbd8c7b6df2d10d2c. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:48:53.271245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-86ac148a-478b-4ffb-bb8e-3f8f4ce4f841 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Getting quotas for user b92925514b544fbe9e34326f9c48cb24 and project 8e8dbc250d3447ecbd8c7b6df2d10d2c. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:48:53.285572 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR oslo.messaging._drivers.impl_rabbit [None req-86ac148a-478b-4ffb-bb8e-3f8f4ce4f841 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [1269fa74-5fdb-4cb5-84cd-baf5a8606b94] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:48:54.272539 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-042a4d12-2456-45cf-8ad0-9a56efe05b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.172870 Aug 24 05:48:54.273066 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 262/524] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 05:48:53 2022] POST /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-volume_attachments => generated 194 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:48:54.278077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7e18c84e-84e5-4530-a931-1496e3256630 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:54.278765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7e18c84e-84e5-4530-a931-1496e3256630 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:54.285298 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e18c84e-84e5-4530-a931-1496e3256630 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:54.285793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e18c84e-84e5-4530-a931-1496e3256630 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:54.286226 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e18c84e-84e5-4530-a931-1496e3256630 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:54.286968 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e18c84e-84e5-4530-a931-1496e3256630 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:54.288559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e18c84e-84e5-4530-a931-1496e3256630 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:54.288559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e18c84e-84e5-4530-a931-1496e3256630 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:54.297323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [None req-86ac148a-478b-4ffb-bb8e-3f8f4ce4f841 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [1269fa74-5fdb-4cb5-84cd-baf5a8606b94] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 49418. Aug 24 05:48:54.400878 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-86ac148a-478b-4ffb-bb8e-3f8f4ce4f841 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.385790 Aug 24 05:48:54.401482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 263/525] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 24 05:48:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:54.406587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:54.407206 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:54.415294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:54.415866 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:54.416593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:54.417198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:54.417956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:54.418563 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:54.434625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7e18c84e-84e5-4530-a931-1496e3256630 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:54.443490 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7e18c84e-84e5-4530-a931-1496e3256630 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1592 microversion: 2.1 time: 0.169269 Aug 24 05:48:54.444110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 263/526] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:54 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1592 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:54.454858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:54.455341 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:54.455781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:54.456237 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lazy-loading 'fault' on Instance uuid 4eae302d-22b2-4682-954f-a617fecc4f9a {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:48:54.500626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:54.524818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7cc2ac6e-9c78-4999-bd61-4443b6b0d5c5 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1304 microversion: 2.1 time: 0.109025 Aug 24 05:48:54.524818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 264/527] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:54 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:55.533586 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:55.537356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:55.542273 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:55.543405 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:55.544256 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:55.544957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:55.545525 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:55.546142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:55.583644 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:55.584418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:55.585028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:55.585868 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lazy-loading 'fault' on Instance uuid 4eae302d-22b2-4682-954f-a617fecc4f9a {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:48:55.636518 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:55.646826 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7c76a3ab-8cb5-45cf-98c3-4370c55ef52a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1304 microversion: 2.1 time: 0.117776 Aug 24 05:48:55.647618 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 264/528] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:55 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:56.681119 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:56.682009 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:56.689395 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:56.692281 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:56.692281 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:56.692281 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:56.692281 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:56.692866 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:56.733402 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:56.734106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:56.734553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:56.735007 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lazy-loading 'fault' on Instance uuid 4eae302d-22b2-4682-954f-a617fecc4f9a {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:48:56.778784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:56.787751 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d951e565-6e15-40be-81ea-b7a91d226c61 tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1304 microversion: 2.1 time: 0.122334 Aug 24 05:48:56.800550 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 265/529] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:56 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:57.095236 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-a604f1b2-08a1-4193-8fe0-93c186b98ff6 req-88b0cb51-e06f-48a4-a604-433799f1ada6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be90cc32-6bea-4a9f-99b6-c47cdbeea246", "tag": "5aeffe0a-e1d3-441b-86b9-7b72a10a2baa"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:57.111414 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-a604f1b2-08a1-4193-8fe0-93c186b98ff6 req-88b0cb51-e06f-48a4-a604-433799f1ada6 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:57.112202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-a604f1b2-08a1-4193-8fe0-93c186b98ff6 req-88b0cb51-e06f-48a4-a604-433799f1ada6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:57.112801 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-a604f1b2-08a1-4193-8fe0-93c186b98ff6 req-88b0cb51-e06f-48a4-a604-433799f1ada6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:57.125039 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-a604f1b2-08a1-4193-8fe0-93c186b98ff6 req-88b0cb51-e06f-48a4-a604-433799f1ada6 service nova] Creating event network-changed:5aeffe0a-e1d3-441b-86b9-7b72a10a2baa for instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 on hv-cinder-85426 Aug 24 05:48:57.131655 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-a604f1b2-08a1-4193-8fe0-93c186b98ff6 req-88b0cb51-e06f-48a4-a604-433799f1ada6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040331 Aug 24 05:48:57.132816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 265/530] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:57.812225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:57.814008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:57.821809 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:57.822406 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:57.823048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:57.823943 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:57.824934 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:57.825586 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:57.882581 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:57.883600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:57.889580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:57.890414 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lazy-loading 'fault' on Instance uuid 4eae302d-22b2-4682-954f-a617fecc4f9a {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:48:57.959796 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bdb5e1c6d145e8a8c6792b2534a836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e1b207a1e9479e88e00371843f7ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:57.969678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bfcb8c7f-807f-4e81-8016-6a9abf61165a tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 200 len: 1304 microversion: 2.1 time: 0.160634 Aug 24 05:48:57.979889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 266/531] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:57 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 1304 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:58.993451 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:58.995938 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] [instance: 4eae302d-22b2-4682-954f-a617fecc4f9a] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:59.005819 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:59.006552 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:59.007071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:59.007917 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:59.008669 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:59.009319 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:59.025463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] HTTP exception thrown: Instance 4eae302d-22b2-4682-954f-a617fecc4f9a could not be found. Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Request method failure captured: Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a HTTP/1.1 Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbuL20HIttHed1Un6hmONjlqfMIKVPKp8TPvkL9p-Ifq1Ml0wJqwNa4U64OU77k9FpL_e6xRBAOiRulPi6e9AMuggnHNCHs6MkPcOsae9E1F_VH_PWDXDBd2LcJJ80qTDEp08tKqIX0Za4jhtYfp48-kY9MVvHLfqz9UNeW9lRBwLq8 Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 53e1b207a1e9479e88e00371843f7ddd Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-VolumesNegativeTest-1719724379 Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:48:59.027154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_53e1b207a1e9479e88e00371843f7ddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53e1b207a1e9479e88e00371843f7ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/53e1b207a1e9479e88e00371843f7ddd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53e1b207a1e9479e88e00371843f7ddd"}]}] Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-VolumesNegativeTest-1719724379 Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 53e1b207a1e9479e88e00371843f7ddd Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-VolumesNegativeTest-1719724379 Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-VolumesNegativeTest-1719724379-project Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: 26bdb5e1c6d145e8a8c6792b2534a836 Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-VolumesNegativeTest-1719724379-project Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 4eae302d-22b2-4682-954f-a617fecc4f9a could not be found. Aug 24 05:48:59.031609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '4eae302d-22b2-4682-954f-a617fecc4f9a'} Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eae302d-22b2-4682-954f-a617fecc4f9a could not be found. Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:48:59.032385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eae302d-22b2-4682-954f-a617fecc4f9a could not be found. Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eae302d-22b2-4682-954f-a617fecc4f9a could not be found. Aug 24 05:48:59.033793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:48:59.035066 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] Returning 404 to user: Instance 4eae302d-22b2-4682-954f-a617fecc4f9a could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:48:59.035066 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e2bd025a-a347-4d32-bec4-9bbb5c61919e tempest-VolumesNegativeTest-1719724379 tempest-VolumesNegativeTest-1719724379-project] 10.222.0.15 "GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a" status: 404 len: 111 microversion: 2.1 time: 0.041102 Aug 24 05:48:59.035066 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 266/532] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:58 2022] GET /compute/v2.1/servers/4eae302d-22b2-4682-954f-a617fecc4f9a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:49:00.422267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a1de1c82-bb7c-447d-bb8f-f4deb4b8d3e7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-824021517"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:00.423034 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a1de1c82-bb7c-447d-bb8f-f4deb4b8d3e7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:00.430695 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a1de1c82-bb7c-447d-bb8f-f4deb4b8d3e7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:00.431191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a1de1c82-bb7c-447d-bb8f-f4deb4b8d3e7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:00.431633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a1de1c82-bb7c-447d-bb8f-f4deb4b8d3e7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:00.432332 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a1de1c82-bb7c-447d-bb8f-f4deb4b8d3e7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:00.432829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a1de1c82-bb7c-447d-bb8f-f4deb4b8d3e7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:00.433256 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a1de1c82-bb7c-447d-bb8f-f4deb4b8d3e7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:00.668543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.network.security_group_api [None req-a1de1c82-bb7c-447d-bb8f-f4deb4b8d3e7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Adding security group f3704b79-bbda-4e65-8565-c5b6c8a2ba9d to port 5aeffe0a-e1d3-441b-86b9-7b72a10a2baa Aug 24 05:49:01.164574 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a1de1c82-bb7c-447d-bb8f-f4deb4b8d3e7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "POST /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/action" status: 202 len: 0 microversion: 2.1 time: 0.747357 Aug 24 05:49:01.165768 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 267/533] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:49:00 2022] POST /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/action => generated 0 bytes in 749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:49:01.174160 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-234ba28b-c344-4e1c-a168-4ce1792e4ee5 req-02c5a40e-e055-4869-be27-e2a451d2aa70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be90cc32-6bea-4a9f-99b6-c47cdbeea246", "tag": "5aeffe0a-e1d3-441b-86b9-7b72a10a2baa"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:01.177576 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e351c337-e66c-4ae0-9cd1-6d9cd722c40b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:01.178278 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e351c337-e66c-4ae0-9cd1-6d9cd722c40b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:01.187237 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e351c337-e66c-4ae0-9cd1-6d9cd722c40b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:01.188097 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e351c337-e66c-4ae0-9cd1-6d9cd722c40b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:01.188771 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e351c337-e66c-4ae0-9cd1-6d9cd722c40b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:01.189772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e351c337-e66c-4ae0-9cd1-6d9cd722c40b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:01.190704 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e351c337-e66c-4ae0-9cd1-6d9cd722c40b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:01.191546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e351c337-e66c-4ae0-9cd1-6d9cd722c40b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:01.198330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-234ba28b-c344-4e1c-a168-4ce1792e4ee5 req-02c5a40e-e055-4869-be27-e2a451d2aa70 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:01.198330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-234ba28b-c344-4e1c-a168-4ce1792e4ee5 req-02c5a40e-e055-4869-be27-e2a451d2aa70 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:01.198787 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-234ba28b-c344-4e1c-a168-4ce1792e4ee5 req-02c5a40e-e055-4869-be27-e2a451d2aa70 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:01.238203 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-234ba28b-c344-4e1c-a168-4ce1792e4ee5 req-02c5a40e-e055-4869-be27-e2a451d2aa70 service nova] Creating event network-changed:5aeffe0a-e1d3-441b-86b9-7b72a10a2baa for instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 on hv-cinder-85426 Aug 24 05:49:01.253705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-234ba28b-c344-4e1c-a168-4ce1792e4ee5 req-02c5a40e-e055-4869-be27-e2a451d2aa70 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082331 Aug 24 05:49:01.256818 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 267/534] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:01.543969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e351c337-e66c-4ae0-9cd1-6d9cd722c40b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:01.556195 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e351c337-e66c-4ae0-9cd1-6d9cd722c40b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1757 microversion: 2.1 time: 0.382992 Aug 24 05:49:01.559707 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 268/535] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:01 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1757 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:07.548186 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-bd0902aa-6115-42aa-849b-6c0d4aefebd8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: .version_select at 0x7f065c13dee0>, body: {"keypair": {"name": "tempest-keypair-219933012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9721nnOG0VnYsYiyZ+sweDA6pdfhiJfXGgHXfa1kWnXFy3FCi4ipw74VNNJfky8eqQ+dkbKP6wM5+aZ3KqpKUXl6tiGe3OrEr3RAATnxn/phTDP0/mkvddkN8MeQU3Aw=="}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:07.564819 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-bd0902aa-6115-42aa-849b-6c0d4aefebd8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'key_pairs'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:49:07.568887 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-bd0902aa-6115-42aa-849b-6c0d4aefebd8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for user d3e6e20d5cd44444b43b1e7abb240f8d and project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'key_pairs'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:49:07.703285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-bd0902aa-6115-42aa-849b-6c0d4aefebd8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.160341 Aug 24 05:49:07.703812 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 268/536] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 24 05:49:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:10.706903 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1250436636", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf3d5dbf-6bc3-460c-95aa-1bef35e2fd6f"}], "security_groups": [{"name": "tempest-securitygroup--1832270795"}], "key_name": "tempest-keypair-219933012", "user_data": "}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:10.718087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=4 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:11.540100 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:18.111878 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.network.neutron [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] validate_networks() for [('cf3d5dbf-6bc3-460c-95aa-1bef35e2fd6f', None, None, None, None, None)] {{(pid=127756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:49:18.312907 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:18.511702 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Flavor limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:49:18.512118 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Image limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:49:18.512620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Flavor pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:49:18.513026 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Image pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:49:18.513432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:49:18.522161 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:18.522642 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:18.523075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:18.523788 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:18.524236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:18.524882 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:18.542828 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:49:18.547259 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for user d3e6e20d5cd44444b43b1e7abb240f8d and project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:49:18.558391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Going to run 1 instances... {{(pid=127756) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:49:18.560854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:49:18.734011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [6f238e99-3e43-42c8-800b-6b8ce75d98d2] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:49:19.747381 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [6f238e99-3e43-42c8-800b-6b8ce75d98d2] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 50008. Aug 24 05:49:19.751595 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5c799625-caa2-4247-a4f2-53de2bbdb2ca tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 9.049315 Aug 24 05:49:19.752342 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 269/537] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:49:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 9051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:49:19.760542 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:19.762292 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=4 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:19.763114 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:19.767278 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c1eb8de3-ee06-482f-8bfd-3dbc0983fc8f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:19.768004 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c1eb8de3-ee06-482f-8bfd-3dbc0983fc8f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:19.831445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c1eb8de3-ee06-482f-8bfd-3dbc0983fc8f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:19.841166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c1eb8de3-ee06-482f-8bfd-3dbc0983fc8f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1241 microversion: 2.1 time: 0.081077 Aug 24 05:49:19.841166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 269/538] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:19 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:20.863763 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-79f4671c-75ec-45b8-9a56-8b7859f8756f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:20.864351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-79f4671c-75ec-45b8-9a56-8b7859f8756f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:20.871645 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79f4671c-75ec-45b8-9a56-8b7859f8756f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:20.872634 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79f4671c-75ec-45b8-9a56-8b7859f8756f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:20.872634 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79f4671c-75ec-45b8-9a56-8b7859f8756f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:20.873302 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79f4671c-75ec-45b8-9a56-8b7859f8756f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:20.873766 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79f4671c-75ec-45b8-9a56-8b7859f8756f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:20.874198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-79f4671c-75ec-45b8-9a56-8b7859f8756f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:20.954057 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-79f4671c-75ec-45b8-9a56-8b7859f8756f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:20.966558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-79f4671c-75ec-45b8-9a56-8b7859f8756f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1245 microversion: 2.1 time: 0.106898 Aug 24 05:49:20.967831 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 270/539] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:20 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:21.988189 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-16c1d0a6-41c4-423d-8600-bd633e788961 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:21.988961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-16c1d0a6-41c4-423d-8600-bd633e788961 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:21.998790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-16c1d0a6-41c4-423d-8600-bd633e788961 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:21.999358 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-16c1d0a6-41c4-423d-8600-bd633e788961 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:21.999824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-16c1d0a6-41c4-423d-8600-bd633e788961 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:22.000567 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-16c1d0a6-41c4-423d-8600-bd633e788961 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:22.001028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-16c1d0a6-41c4-423d-8600-bd633e788961 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:22.001460 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-16c1d0a6-41c4-423d-8600-bd633e788961 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:22.075032 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-16c1d0a6-41c4-423d-8600-bd633e788961 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:22.083479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-16c1d0a6-41c4-423d-8600-bd633e788961 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1293 microversion: 2.1 time: 0.099865 Aug 24 05:49:22.084054 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 270/540] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:21 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:23.109901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-34dfb340-7b94-4383-89b2-3107df8891ef tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:23.111221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-34dfb340-7b94-4383-89b2-3107df8891ef tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:23.122166 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-34dfb340-7b94-4383-89b2-3107df8891ef tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:23.123020 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-34dfb340-7b94-4383-89b2-3107df8891ef tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:23.123762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-34dfb340-7b94-4383-89b2-3107df8891ef tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:23.124971 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-34dfb340-7b94-4383-89b2-3107df8891ef tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:23.125794 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-34dfb340-7b94-4383-89b2-3107df8891ef tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:23.126352 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-34dfb340-7b94-4383-89b2-3107df8891ef tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:23.421451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-34dfb340-7b94-4383-89b2-3107df8891ef tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:23.430033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-34dfb340-7b94-4383-89b2-3107df8891ef tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1311 microversion: 2.1 time: 0.329618 Aug 24 05:49:23.430914 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 271/541] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:23 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1311 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:24.454250 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-cebdb646-e500-4c33-86a6-2e8c9be05cfb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:24.454867 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-cebdb646-e500-4c33-86a6-2e8c9be05cfb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:24.464173 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cebdb646-e500-4c33-86a6-2e8c9be05cfb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:24.465848 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cebdb646-e500-4c33-86a6-2e8c9be05cfb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:24.466682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cebdb646-e500-4c33-86a6-2e8c9be05cfb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:24.467531 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cebdb646-e500-4c33-86a6-2e8c9be05cfb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:24.468165 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cebdb646-e500-4c33-86a6-2e8c9be05cfb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:24.469499 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cebdb646-e500-4c33-86a6-2e8c9be05cfb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:24.641553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-cebdb646-e500-4c33-86a6-2e8c9be05cfb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:24.651542 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-cebdb646-e500-4c33-86a6-2e8c9be05cfb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.202332 Aug 24 05:49:24.653047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 271/542] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:24 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:24.669596 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-e47fadb4-e919-4800-8ecb-757a60657127 req-211da322-ea57-453b-8b65-a4d3e71cdab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa31986-0501-4c2b-a261-04ff2fc14bc6", "tag": "fec74210-d3e0-46a6-b579-1212f8c1053f"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:24.685210 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-e47fadb4-e919-4800-8ecb-757a60657127 req-211da322-ea57-453b-8b65-a4d3e71cdab6 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:24.685210 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-e47fadb4-e919-4800-8ecb-757a60657127 req-211da322-ea57-453b-8b65-a4d3e71cdab6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:24.685210 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-e47fadb4-e919-4800-8ecb-757a60657127 req-211da322-ea57-453b-8b65-a4d3e71cdab6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:24.697204 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-e47fadb4-e919-4800-8ecb-757a60657127 req-211da322-ea57-453b-8b65-a4d3e71cdab6 service nova] Creating event network-changed:fec74210-d3e0-46a6-b579-1212f8c1053f for instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 on hv-cinder-85426 Aug 24 05:49:24.703352 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-e47fadb4-e919-4800-8ecb-757a60657127 req-211da322-ea57-453b-8b65-a4d3e71cdab6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039223 Aug 24 05:49:24.704086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 272/543] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:25.674088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7a896fe0-7a0b-4b62-8b81-b34ef193885d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:25.674737 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7a896fe0-7a0b-4b62-8b81-b34ef193885d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:25.681766 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a896fe0-7a0b-4b62-8b81-b34ef193885d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:25.682263 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a896fe0-7a0b-4b62-8b81-b34ef193885d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:25.682708 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a896fe0-7a0b-4b62-8b81-b34ef193885d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:25.683457 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a896fe0-7a0b-4b62-8b81-b34ef193885d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:25.683920 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a896fe0-7a0b-4b62-8b81-b34ef193885d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:25.684348 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7a896fe0-7a0b-4b62-8b81-b34ef193885d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:25.991656 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7a896fe0-7a0b-4b62-8b81-b34ef193885d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:26.000874 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7a896fe0-7a0b-4b62-8b81-b34ef193885d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.330631 Aug 24 05:49:26.001438 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 272/544] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:25 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:27.023836 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-452144ec-8d47-4c51-ae95-50c40ac510a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:27.024547 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-452144ec-8d47-4c51-ae95-50c40ac510a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:27.031636 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-452144ec-8d47-4c51-ae95-50c40ac510a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:27.032116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-452144ec-8d47-4c51-ae95-50c40ac510a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:27.032591 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-452144ec-8d47-4c51-ae95-50c40ac510a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:27.033287 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-452144ec-8d47-4c51-ae95-50c40ac510a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:27.033821 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-452144ec-8d47-4c51-ae95-50c40ac510a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:27.034159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-452144ec-8d47-4c51-ae95-50c40ac510a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:27.169806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-452144ec-8d47-4c51-ae95-50c40ac510a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:27.178224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-452144ec-8d47-4c51-ae95-50c40ac510a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.159013 Aug 24 05:49:27.178826 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 273/545] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:27 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:28.205822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-79d71e7c-dabe-40a4-99e6-bb583449941b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:28.206913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-79d71e7c-dabe-40a4-99e6-bb583449941b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:28.219725 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79d71e7c-dabe-40a4-99e6-bb583449941b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:28.220643 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79d71e7c-dabe-40a4-99e6-bb583449941b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:28.221463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79d71e7c-dabe-40a4-99e6-bb583449941b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:28.222667 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79d71e7c-dabe-40a4-99e6-bb583449941b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:28.223463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79d71e7c-dabe-40a4-99e6-bb583449941b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:28.224196 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79d71e7c-dabe-40a4-99e6-bb583449941b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:28.403672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-79d71e7c-dabe-40a4-99e6-bb583449941b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:28.412164 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-79d71e7c-dabe-40a4-99e6-bb583449941b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.214246 Aug 24 05:49:28.412793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 273/546] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:28 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:29.433665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-28812a31-b55d-4555-98c9-02bc96f2b6b2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:29.434277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-28812a31-b55d-4555-98c9-02bc96f2b6b2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:29.437575 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:29.438305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=6 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:29.443320 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28812a31-b55d-4555-98c9-02bc96f2b6b2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:29.447205 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28812a31-b55d-4555-98c9-02bc96f2b6b2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:29.447205 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28812a31-b55d-4555-98c9-02bc96f2b6b2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:29.447205 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28812a31-b55d-4555-98c9-02bc96f2b6b2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:29.447205 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28812a31-b55d-4555-98c9-02bc96f2b6b2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:29.447604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28812a31-b55d-4555-98c9-02bc96f2b6b2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:29.584512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-28812a31-b55d-4555-98c9-02bc96f2b6b2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:29.593371 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-28812a31-b55d-4555-98c9-02bc96f2b6b2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.163549 Aug 24 05:49:29.593980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 274/547] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:29 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:30.615169 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9fd63d8a-c603-476d-9607-8949f55b8593 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:30.615861 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9fd63d8a-c603-476d-9607-8949f55b8593 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:30.624746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd63d8a-c603-476d-9607-8949f55b8593 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.625281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd63d8a-c603-476d-9607-8949f55b8593 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.625718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd63d8a-c603-476d-9607-8949f55b8593 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:30.626433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd63d8a-c603-476d-9607-8949f55b8593 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.626882 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd63d8a-c603-476d-9607-8949f55b8593 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.627307 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9fd63d8a-c603-476d-9607-8949f55b8593 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:30.773028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9fd63d8a-c603-476d-9607-8949f55b8593 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:30.782285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9fd63d8a-c603-476d-9607-8949f55b8593 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.170842 Aug 24 05:49:30.783179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 274/548] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:30 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:31.804191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-04c0206d-74db-41a8-bbba-2a66ecb77860 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:31.804863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-04c0206d-74db-41a8-bbba-2a66ecb77860 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:31.812483 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04c0206d-74db-41a8-bbba-2a66ecb77860 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.812991 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04c0206d-74db-41a8-bbba-2a66ecb77860 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.813432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04c0206d-74db-41a8-bbba-2a66ecb77860 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.814157 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04c0206d-74db-41a8-bbba-2a66ecb77860 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.814620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04c0206d-74db-41a8-bbba-2a66ecb77860 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.815049 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04c0206d-74db-41a8-bbba-2a66ecb77860 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.961003 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-04c0206d-74db-41a8-bbba-2a66ecb77860 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:31.970107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-04c0206d-74db-41a8-bbba-2a66ecb77860 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.170060 Aug 24 05:49:31.970741 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 275/549] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:31 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:32.992521 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8b2a9c20-3d3f-4e16-a2b2-f37af7c1b8be tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:32.993220 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8b2a9c20-3d3f-4e16-a2b2-f37af7c1b8be tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:32.995605 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:33.002207 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8b2a9c20-3d3f-4e16-a2b2-f37af7c1b8be tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:33.002705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8b2a9c20-3d3f-4e16-a2b2-f37af7c1b8be tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:33.003203 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8b2a9c20-3d3f-4e16-a2b2-f37af7c1b8be tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:33.003924 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8b2a9c20-3d3f-4e16-a2b2-f37af7c1b8be tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:33.004383 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8b2a9c20-3d3f-4e16-a2b2-f37af7c1b8be tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:33.010487 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8b2a9c20-3d3f-4e16-a2b2-f37af7c1b8be tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:33.155159 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8b2a9c20-3d3f-4e16-a2b2-f37af7c1b8be tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:33.165960 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8b2a9c20-3d3f-4e16-a2b2-f37af7c1b8be tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.177188 Aug 24 05:49:33.166722 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 275/550] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:32 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:34.188672 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bc479eed-fb74-4039-91b1-2a05eb7375de tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:34.189242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bc479eed-fb74-4039-91b1-2a05eb7375de tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:34.196136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc479eed-fb74-4039-91b1-2a05eb7375de tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.196665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc479eed-fb74-4039-91b1-2a05eb7375de tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.197098 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc479eed-fb74-4039-91b1-2a05eb7375de tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.197850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc479eed-fb74-4039-91b1-2a05eb7375de tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.198299 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc479eed-fb74-4039-91b1-2a05eb7375de tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.198716 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bc479eed-fb74-4039-91b1-2a05eb7375de tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.339053 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bc479eed-fb74-4039-91b1-2a05eb7375de tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:34.347305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bc479eed-fb74-4039-91b1-2a05eb7375de tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.163381 Aug 24 05:49:34.347874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 276/551] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:34 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:35.369081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c771818f-9679-427b-872a-312592bbbb61 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:35.369693 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c771818f-9679-427b-872a-312592bbbb61 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:35.377835 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c771818f-9679-427b-872a-312592bbbb61 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:35.378352 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c771818f-9679-427b-872a-312592bbbb61 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:35.378794 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c771818f-9679-427b-872a-312592bbbb61 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:35.379534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c771818f-9679-427b-872a-312592bbbb61 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:35.380003 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c771818f-9679-427b-872a-312592bbbb61 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:35.380468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c771818f-9679-427b-872a-312592bbbb61 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:35.626503 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c771818f-9679-427b-872a-312592bbbb61 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:35.637508 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c771818f-9679-427b-872a-312592bbbb61 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.272835 Aug 24 05:49:35.639193 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 276/552] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:35 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:35.860841 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-cb19296b-6d90-4226-b1e1-1623aa03f4cd req-7eca6669-49d9-4b1d-812d-1c4a0bcfedd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa31986-0501-4c2b-a261-04ff2fc14bc6", "name": "network-vif-plugged", "status": "completed", "tag": "fec74210-d3e0-46a6-b579-1212f8c1053f"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:35.872576 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-cb19296b-6d90-4226-b1e1-1623aa03f4cd req-7eca6669-49d9-4b1d-812d-1c4a0bcfedd3 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:35.872981 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-cb19296b-6d90-4226-b1e1-1623aa03f4cd req-7eca6669-49d9-4b1d-812d-1c4a0bcfedd3 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:35.873524 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-cb19296b-6d90-4226-b1e1-1623aa03f4cd req-7eca6669-49d9-4b1d-812d-1c4a0bcfedd3 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:35.888787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-cb19296b-6d90-4226-b1e1-1623aa03f4cd req-7eca6669-49d9-4b1d-812d-1c4a0bcfedd3 service nova] Creating event network-vif-plugged:fec74210-d3e0-46a6-b579-1212f8c1053f for instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 on hv-cinder-85426 Aug 24 05:49:35.894128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-cb19296b-6d90-4226-b1e1-1623aa03f4cd req-7eca6669-49d9-4b1d-812d-1c4a0bcfedd3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037965 Aug 24 05:49:35.894728 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 277/553] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:49:36.215875 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-489267119", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1642854592", "security_groups": [{"name": "tempest-secgroup-smoke-152603612"}], "block_device_mapping_v2": [{"uuid": "6c8835b7-f9d6-44e2-a10f-2d791bd6ba84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f65f9f7a-ac88-464d-85df-73c9c53a7e50"}]}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:36.369746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] validate_networks() for [('f65f9f7a-ac88-464d-85df-73c9c53a7e50', None, None, None, None, None)] {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:49:36.721819 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9a207c05-b428-4c7f-a719-8274a2938e57 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:36.722794 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9a207c05-b428-4c7f-a719-8274a2938e57 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:36.730144 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a207c05-b428-4c7f-a719-8274a2938e57 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:36.730628 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a207c05-b428-4c7f-a719-8274a2938e57 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:36.731067 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a207c05-b428-4c7f-a719-8274a2938e57 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:36.732619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a207c05-b428-4c7f-a719-8274a2938e57 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:36.733088 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a207c05-b428-4c7f-a719-8274a2938e57 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:36.733515 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a207c05-b428-4c7f-a719-8274a2938e57 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:36.809637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:49:36.810128 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:49:36.811132 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:49:36.811609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:49:36.812204 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:49:36.822439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:36.822439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:36.822783 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:36.823530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:36.824187 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:36.824647 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:36.848050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Getting quotas for project 8e8dbc250d3447ecbd8c7b6df2d10d2c. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:49:36.853649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Getting quotas for user b92925514b544fbe9e34326f9c48cb24 and project 8e8dbc250d3447ecbd8c7b6df2d10d2c. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:49:36.920819 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:49:36.923064 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c8835b7-f9d6-44e2-a10f-2d791bd6ba84',volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:49:36.948565 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9a207c05-b428-4c7f-a719-8274a2938e57 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:36.959565 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9a207c05-b428-4c7f-a719-8274a2938e57 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.299140 Aug 24 05:49:36.960530 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 278/554] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:36 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:37.425589 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-37596d7f-8f13-4d82-8ee4-5d3e28159cf0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.213521 Aug 24 05:49:37.426990 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 277/555] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:49:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:49:37.438479 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6144d476-9092-419f-8c34-47a252750395 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:37.439037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6144d476-9092-419f-8c34-47a252750395 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:37.494470 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6144d476-9092-419f-8c34-47a252750395 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:37.504213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6144d476-9092-419f-8c34-47a252750395 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1094 microversion: 2.1 time: 0.070323 Aug 24 05:49:37.504849 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 279/556] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:37 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:37.980832 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-17ec4d13-6856-43a2-a570-69e71cf38a47 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:37.981496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-17ec4d13-6856-43a2-a570-69e71cf38a47 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:37.988850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-17ec4d13-6856-43a2-a570-69e71cf38a47 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.989456 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-17ec4d13-6856-43a2-a570-69e71cf38a47 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.989777 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-17ec4d13-6856-43a2-a570-69e71cf38a47 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:37.990506 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-17ec4d13-6856-43a2-a570-69e71cf38a47 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.990971 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-17ec4d13-6856-43a2-a570-69e71cf38a47 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.991409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-17ec4d13-6856-43a2-a570-69e71cf38a47 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:38.144009 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-17ec4d13-6856-43a2-a570-69e71cf38a47 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:38.152476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-17ec4d13-6856-43a2-a570-69e71cf38a47 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.175585 Aug 24 05:49:38.153338 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 278/557] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:37 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:38.524685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e19e32c0-6393-40b2-834e-95c2a0287071 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:38.525348 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e19e32c0-6393-40b2-834e-95c2a0287071 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:38.595853 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e19e32c0-6393-40b2-834e-95c2a0287071 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:38.605839 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e19e32c0-6393-40b2-834e-95c2a0287071 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1094 microversion: 2.1 time: 0.085276 Aug 24 05:49:38.606471 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 280/558] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:38 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:39.173858 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-198d69c6-6148-46e2-9ac3-7893ab39d1b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:39.174470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-198d69c6-6148-46e2-9ac3-7893ab39d1b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:39.181349 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-198d69c6-6148-46e2-9ac3-7893ab39d1b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.181902 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-198d69c6-6148-46e2-9ac3-7893ab39d1b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.182525 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-198d69c6-6148-46e2-9ac3-7893ab39d1b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.183242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-198d69c6-6148-46e2-9ac3-7893ab39d1b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.183698 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-198d69c6-6148-46e2-9ac3-7893ab39d1b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.184132 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-198d69c6-6148-46e2-9ac3-7893ab39d1b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.329723 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-198d69c6-6148-46e2-9ac3-7893ab39d1b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:39.337874 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-198d69c6-6148-46e2-9ac3-7893ab39d1b1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1367 microversion: 2.1 time: 0.168103 Aug 24 05:49:39.338454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 279/559] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:39 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:39.628104 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ce9361ea-c632-4ce7-8f80-003e3b9ec5a5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:39.629273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ce9361ea-c632-4ce7-8f80-003e3b9ec5a5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:39.636874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce9361ea-c632-4ce7-8f80-003e3b9ec5a5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.637394 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce9361ea-c632-4ce7-8f80-003e3b9ec5a5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.638567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce9361ea-c632-4ce7-8f80-003e3b9ec5a5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.639590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce9361ea-c632-4ce7-8f80-003e3b9ec5a5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.640056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce9361ea-c632-4ce7-8f80-003e3b9ec5a5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.640521 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce9361ea-c632-4ce7-8f80-003e3b9ec5a5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.706149 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ce9361ea-c632-4ce7-8f80-003e3b9ec5a5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:39.714233 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ce9361ea-c632-4ce7-8f80-003e3b9ec5a5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1192 microversion: 2.1 time: 0.090058 Aug 24 05:49:39.715461 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 281/560] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:39 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:40.359444 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-23d7b690-8919-4fde-b7af-498b4c21ef15 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:40.360051 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-23d7b690-8919-4fde-b7af-498b4c21ef15 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:40.366694 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23d7b690-8919-4fde-b7af-498b4c21ef15 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.367178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23d7b690-8919-4fde-b7af-498b4c21ef15 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.367778 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23d7b690-8919-4fde-b7af-498b4c21ef15 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.368499 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23d7b690-8919-4fde-b7af-498b4c21ef15 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.368953 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23d7b690-8919-4fde-b7af-498b4c21ef15 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.369376 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-23d7b690-8919-4fde-b7af-498b4c21ef15 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.510331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-23d7b690-8919-4fde-b7af-498b4c21ef15 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:40.519207 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-23d7b690-8919-4fde-b7af-498b4c21ef15 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1558 microversion: 2.1 time: 0.163886 Aug 24 05:49:40.519781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 280/561] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:40 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:40.540388 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3d462d26-0130-4da1-b86a-a6665b1e42db tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:40.540912 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3d462d26-0130-4da1-b86a-a6665b1e42db tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:40.547263 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d462d26-0130-4da1-b86a-a6665b1e42db tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.547742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d462d26-0130-4da1-b86a-a6665b1e42db tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.548175 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d462d26-0130-4da1-b86a-a6665b1e42db tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.548886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d462d26-0130-4da1-b86a-a6665b1e42db tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.549338 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d462d26-0130-4da1-b86a-a6665b1e42db tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.549753 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d462d26-0130-4da1-b86a-a6665b1e42db tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.631466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3d462d26-0130-4da1-b86a-a6665b1e42db tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095007 Aug 24 05:49:40.632091 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 282/562] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 24 05:49:40 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:40.737585 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0a869463-65e3-44af-8feb-8538f4c6f782 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:40.738280 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0a869463-65e3-44af-8feb-8538f4c6f782 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:40.745459 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a869463-65e3-44af-8feb-8538f4c6f782 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.746161 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a869463-65e3-44af-8feb-8538f4c6f782 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.747654 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a869463-65e3-44af-8feb-8538f4c6f782 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.748764 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a869463-65e3-44af-8feb-8538f4c6f782 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.749408 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a869463-65e3-44af-8feb-8538f4c6f782 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.749918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0a869463-65e3-44af-8feb-8538f4c6f782 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.828750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0a869463-65e3-44af-8feb-8538f4c6f782 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:40.838043 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0a869463-65e3-44af-8feb-8538f4c6f782 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1200 microversion: 2.1 time: 0.104251 Aug 24 05:49:40.838915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 281/563] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:40 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1200 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:41.862344 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-57987d94-e235-4f00-87c4-588ff7657634 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:41.862961 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-57987d94-e235-4f00-87c4-588ff7657634 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:41.884250 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57987d94-e235-4f00-87c4-588ff7657634 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.884746 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57987d94-e235-4f00-87c4-588ff7657634 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.885185 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57987d94-e235-4f00-87c4-588ff7657634 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.886083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57987d94-e235-4f00-87c4-588ff7657634 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.886692 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57987d94-e235-4f00-87c4-588ff7657634 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.887312 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57987d94-e235-4f00-87c4-588ff7657634 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.898114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=59 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:41.962859 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-57987d94-e235-4f00-87c4-588ff7657634 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:41.974933 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-57987d94-e235-4f00-87c4-588ff7657634 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1210 microversion: 2.1 time: 0.116859 Aug 24 05:49:41.982096 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 283/564] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:41 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:42.034465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-f2925edc-1b92-4c68-a521-70048eb629d6 req-68f539c4-d753-4c13-9928-72fe2445a7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa31986-0501-4c2b-a261-04ff2fc14bc6", "tag": "fec74210-d3e0-46a6-b579-1212f8c1053f"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:42.058238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-f2925edc-1b92-4c68-a521-70048eb629d6 req-68f539c4-d753-4c13-9928-72fe2445a7a6 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:42.072533 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-f2925edc-1b92-4c68-a521-70048eb629d6 req-68f539c4-d753-4c13-9928-72fe2445a7a6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:42.072533 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-f2925edc-1b92-4c68-a521-70048eb629d6 req-68f539c4-d753-4c13-9928-72fe2445a7a6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:42.080639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-f2925edc-1b92-4c68-a521-70048eb629d6 req-68f539c4-d753-4c13-9928-72fe2445a7a6 service nova] Creating event network-changed:fec74210-d3e0-46a6-b579-1212f8c1053f for instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 on hv-cinder-85426 Aug 24 05:49:42.088579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-f2925edc-1b92-4c68-a521-70048eb629d6 req-68f539c4-d753-4c13-9928-72fe2445a7a6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058730 Aug 24 05:49:42.095447 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 282/565] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:43.002673 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a75dc5e7-fcac-49f6-8c35-cd7772bac2ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:43.003296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a75dc5e7-fcac-49f6-8c35-cd7772bac2ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:43.010711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75dc5e7-fcac-49f6-8c35-cd7772bac2ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.011201 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75dc5e7-fcac-49f6-8c35-cd7772bac2ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.011844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75dc5e7-fcac-49f6-8c35-cd7772bac2ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.013279 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75dc5e7-fcac-49f6-8c35-cd7772bac2ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.014148 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75dc5e7-fcac-49f6-8c35-cd7772bac2ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.014768 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a75dc5e7-fcac-49f6-8c35-cd7772bac2ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.173803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a75dc5e7-fcac-49f6-8c35-cd7772bac2ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:43.182692 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a75dc5e7-fcac-49f6-8c35-cd7772bac2ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.183796 Aug 24 05:49:43.183618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 284/566] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:42 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:43.223639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-d1c5e99b-9a3a-4e6f-a4b1-b403c63e1057 req-4b07245d-9ab8-4647-93c8-f0cc6137755b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97293205-ac16-434c-bdc0-12c736460ba3", "tag": "c624c6e8-1b3d-4eb1-9e25-5d73924aaefa"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:43.233407 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-d1c5e99b-9a3a-4e6f-a4b1-b403c63e1057 req-4b07245d-9ab8-4647-93c8-f0cc6137755b service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.233982 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-d1c5e99b-9a3a-4e6f-a4b1-b403c63e1057 req-4b07245d-9ab8-4647-93c8-f0cc6137755b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.234491 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-d1c5e99b-9a3a-4e6f-a4b1-b403c63e1057 req-4b07245d-9ab8-4647-93c8-f0cc6137755b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.246317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-d1c5e99b-9a3a-4e6f-a4b1-b403c63e1057 req-4b07245d-9ab8-4647-93c8-f0cc6137755b service nova] Creating event network-changed:c624c6e8-1b3d-4eb1-9e25-5d73924aaefa for instance 97293205-ac16-434c-bdc0-12c736460ba3 on hv-cinder-85426 Aug 24 05:49:43.252047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-d1c5e99b-9a3a-4e6f-a4b1-b403c63e1057 req-4b07245d-9ab8-4647-93c8-f0cc6137755b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033829 Aug 24 05:49:43.263182 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 283/567] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:44.209132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-eb694692-9487-4b1d-8905-94f911d27020 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:44.209753 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-eb694692-9487-4b1d-8905-94f911d27020 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:44.216813 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb694692-9487-4b1d-8905-94f911d27020 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.217301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb694692-9487-4b1d-8905-94f911d27020 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.217743 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb694692-9487-4b1d-8905-94f911d27020 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:44.218437 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb694692-9487-4b1d-8905-94f911d27020 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.218894 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb694692-9487-4b1d-8905-94f911d27020 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.219320 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eb694692-9487-4b1d-8905-94f911d27020 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:44.357310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-eb694692-9487-4b1d-8905-94f911d27020 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:44.365607 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-eb694692-9487-4b1d-8905-94f911d27020 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.160420 Aug 24 05:49:44.366345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 285/568] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:44 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:45.388626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b3d661e7-a9e7-4089-8060-1365bd2b0ff6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:45.389872 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b3d661e7-a9e7-4089-8060-1365bd2b0ff6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:45.396267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b3d661e7-a9e7-4089-8060-1365bd2b0ff6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.396782 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b3d661e7-a9e7-4089-8060-1365bd2b0ff6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.397218 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b3d661e7-a9e7-4089-8060-1365bd2b0ff6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.397910 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b3d661e7-a9e7-4089-8060-1365bd2b0ff6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.398361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b3d661e7-a9e7-4089-8060-1365bd2b0ff6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.398782 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b3d661e7-a9e7-4089-8060-1365bd2b0ff6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.538469 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b3d661e7-a9e7-4089-8060-1365bd2b0ff6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:45.547048 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b3d661e7-a9e7-4089-8060-1365bd2b0ff6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.163189 Aug 24 05:49:45.547615 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 284/569] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:45 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:46.569695 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-003af4e0-3327-4b71-9d29-a603b46ab800 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:46.570081 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-003af4e0-3327-4b71-9d29-a603b46ab800 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:46.575667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-003af4e0-3327-4b71-9d29-a603b46ab800 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:46.579633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-003af4e0-3327-4b71-9d29-a603b46ab800 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:46.579633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-003af4e0-3327-4b71-9d29-a603b46ab800 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:46.579633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-003af4e0-3327-4b71-9d29-a603b46ab800 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:46.579633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-003af4e0-3327-4b71-9d29-a603b46ab800 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:46.580046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-003af4e0-3327-4b71-9d29-a603b46ab800 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:46.728048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-003af4e0-3327-4b71-9d29-a603b46ab800 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:46.736285 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-003af4e0-3327-4b71-9d29-a603b46ab800 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.171149 Aug 24 05:49:46.741015 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 286/570] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:46 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:47.757377 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-524d20b9-0c63-4960-bbff-cbdef69db8b2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:47.757991 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-524d20b9-0c63-4960-bbff-cbdef69db8b2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:47.760484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:47.761202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=6 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:47.767043 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-524d20b9-0c63-4960-bbff-cbdef69db8b2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:47.769409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-524d20b9-0c63-4960-bbff-cbdef69db8b2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:47.769409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-524d20b9-0c63-4960-bbff-cbdef69db8b2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:47.769409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-524d20b9-0c63-4960-bbff-cbdef69db8b2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:47.769409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-524d20b9-0c63-4960-bbff-cbdef69db8b2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:47.769748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-524d20b9-0c63-4960-bbff-cbdef69db8b2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:47.909653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-524d20b9-0c63-4960-bbff-cbdef69db8b2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:47.918015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-524d20b9-0c63-4960-bbff-cbdef69db8b2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.164389 Aug 24 05:49:47.918603 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 285/571] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:47 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:48.942751 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d3e88077-1af5-4ab2-a4e7-7824b0036d8c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:48.943396 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d3e88077-1af5-4ab2-a4e7-7824b0036d8c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:48.945736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=4 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:48.946545 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:48.951087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3e88077-1af5-4ab2-a4e7-7824b0036d8c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:48.951677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3e88077-1af5-4ab2-a4e7-7824b0036d8c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:48.952522 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3e88077-1af5-4ab2-a4e7-7824b0036d8c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:48.953222 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3e88077-1af5-4ab2-a4e7-7824b0036d8c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:48.953677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3e88077-1af5-4ab2-a4e7-7824b0036d8c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:48.954102 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3e88077-1af5-4ab2-a4e7-7824b0036d8c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:49.136343 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d3e88077-1af5-4ab2-a4e7-7824b0036d8c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:49.145622 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d3e88077-1af5-4ab2-a4e7-7824b0036d8c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.206583 Aug 24 05:49:49.146207 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 287/572] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:48 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:50.166160 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6fa92a1e-7c8a-46d0-94c4-a8359f7c0fc1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:50.166810 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6fa92a1e-7c8a-46d0-94c4-a8359f7c0fc1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:50.174256 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa92a1e-7c8a-46d0-94c4-a8359f7c0fc1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:50.174739 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa92a1e-7c8a-46d0-94c4-a8359f7c0fc1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:50.175186 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa92a1e-7c8a-46d0-94c4-a8359f7c0fc1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:50.175904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa92a1e-7c8a-46d0-94c4-a8359f7c0fc1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:50.176341 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa92a1e-7c8a-46d0-94c4-a8359f7c0fc1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:50.176801 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6fa92a1e-7c8a-46d0-94c4-a8359f7c0fc1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:50.316443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6fa92a1e-7c8a-46d0-94c4-a8359f7c0fc1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:50.324549 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6fa92a1e-7c8a-46d0-94c4-a8359f7c0fc1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.162179 Aug 24 05:49:50.325132 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 286/573] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:50 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:51.347057 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-628d3205-72d9-418f-b946-91e0bccb19e4 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:51.347667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-628d3205-72d9-418f-b946-91e0bccb19e4 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:51.354449 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-628d3205-72d9-418f-b946-91e0bccb19e4 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:51.354938 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-628d3205-72d9-418f-b946-91e0bccb19e4 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:51.355378 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-628d3205-72d9-418f-b946-91e0bccb19e4 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:51.356078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-628d3205-72d9-418f-b946-91e0bccb19e4 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:51.356689 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-628d3205-72d9-418f-b946-91e0bccb19e4 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:51.357121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-628d3205-72d9-418f-b946-91e0bccb19e4 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:51.496218 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-628d3205-72d9-418f-b946-91e0bccb19e4 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:51.504966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-628d3205-72d9-418f-b946-91e0bccb19e4 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.162765 Aug 24 05:49:51.505536 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 288/574] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:51 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:52.526290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-aac281c6-b48b-432e-8dc5-aa14653198f7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:52.526836 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-aac281c6-b48b-432e-8dc5-aa14653198f7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:52.529149 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:52.533919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aac281c6-b48b-432e-8dc5-aa14653198f7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:52.534395 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aac281c6-b48b-432e-8dc5-aa14653198f7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:52.534822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aac281c6-b48b-432e-8dc5-aa14653198f7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:52.535503 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aac281c6-b48b-432e-8dc5-aa14653198f7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:52.535954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aac281c6-b48b-432e-8dc5-aa14653198f7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:52.536374 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aac281c6-b48b-432e-8dc5-aa14653198f7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:52.538913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=91 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:52.673140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-aac281c6-b48b-432e-8dc5-aa14653198f7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:52.681088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-aac281c6-b48b-432e-8dc5-aa14653198f7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.158751 Aug 24 05:49:52.682285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 287/575] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:52 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:53.704346 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a88509d1-2d2c-45f8-a403-3db997200c42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:53.705071 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a88509d1-2d2c-45f8-a403-3db997200c42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:53.714972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a88509d1-2d2c-45f8-a403-3db997200c42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:53.715480 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a88509d1-2d2c-45f8-a403-3db997200c42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:53.715923 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a88509d1-2d2c-45f8-a403-3db997200c42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:53.716673 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a88509d1-2d2c-45f8-a403-3db997200c42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:53.717137 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a88509d1-2d2c-45f8-a403-3db997200c42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:53.717600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a88509d1-2d2c-45f8-a403-3db997200c42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:53.866409 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a88509d1-2d2c-45f8-a403-3db997200c42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:53.875131 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a88509d1-2d2c-45f8-a403-3db997200c42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.176056 Aug 24 05:49:53.875703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 289/576] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:53 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:54.895741 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-be0895d0-cfb9-428d-8d96-4888b7af2ead tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:54.896346 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-be0895d0-cfb9-428d-8d96-4888b7af2ead tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:54.903346 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be0895d0-cfb9-428d-8d96-4888b7af2ead tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:54.903846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be0895d0-cfb9-428d-8d96-4888b7af2ead tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:54.904285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be0895d0-cfb9-428d-8d96-4888b7af2ead tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:54.905717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be0895d0-cfb9-428d-8d96-4888b7af2ead tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:54.906485 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be0895d0-cfb9-428d-8d96-4888b7af2ead tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:54.906925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be0895d0-cfb9-428d-8d96-4888b7af2ead tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:55.042636 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-be0895d0-cfb9-428d-8d96-4888b7af2ead tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:55.051009 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-be0895d0-cfb9-428d-8d96-4888b7af2ead tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.159051 Aug 24 05:49:55.051588 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 288/577] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:54 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:56.071346 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-edce8d7d-12ac-4c9e-888d-1f67f9bf6afa tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:56.071907 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-edce8d7d-12ac-4c9e-888d-1f67f9bf6afa tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:56.078580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edce8d7d-12ac-4c9e-888d-1f67f9bf6afa tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.084864 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edce8d7d-12ac-4c9e-888d-1f67f9bf6afa tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.084864 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edce8d7d-12ac-4c9e-888d-1f67f9bf6afa tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.084864 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edce8d7d-12ac-4c9e-888d-1f67f9bf6afa tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.084864 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edce8d7d-12ac-4c9e-888d-1f67f9bf6afa tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.085296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-edce8d7d-12ac-4c9e-888d-1f67f9bf6afa tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.244313 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-edce8d7d-12ac-4c9e-888d-1f67f9bf6afa tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:56.252872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-edce8d7d-12ac-4c9e-888d-1f67f9bf6afa tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.185452 Aug 24 05:49:56.253456 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 290/578] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:56 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:56.344159 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-1463d93e-e180-43d6-a403-40e7f223f2d4 req-2a53dc8d-76af-4ed1-ba74-2fe654feb416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97293205-ac16-434c-bdc0-12c736460ba3", "name": "network-vif-plugged", "status": "completed", "tag": "c624c6e8-1b3d-4eb1-9e25-5d73924aaefa"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:56.354596 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-1463d93e-e180-43d6-a403-40e7f223f2d4 req-2a53dc8d-76af-4ed1-ba74-2fe654feb416 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.355073 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-1463d93e-e180-43d6-a403-40e7f223f2d4 req-2a53dc8d-76af-4ed1-ba74-2fe654feb416 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.355510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-1463d93e-e180-43d6-a403-40e7f223f2d4 req-2a53dc8d-76af-4ed1-ba74-2fe654feb416 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.366892 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-1463d93e-e180-43d6-a403-40e7f223f2d4 req-2a53dc8d-76af-4ed1-ba74-2fe654feb416 service nova] Creating event network-vif-plugged:c624c6e8-1b3d-4eb1-9e25-5d73924aaefa for instance 97293205-ac16-434c-bdc0-12c736460ba3 on hv-cinder-85426 Aug 24 05:49:56.376781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-1463d93e-e180-43d6-a403-40e7f223f2d4 req-2a53dc8d-76af-4ed1-ba74-2fe654feb416 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032292 Aug 24 05:49:56.376781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 289/579] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:57.274690 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6faee7e0-b623-463e-9df5-fb7f22d2b831 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:57.275275 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6faee7e0-b623-463e-9df5-fb7f22d2b831 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:57.282930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6faee7e0-b623-463e-9df5-fb7f22d2b831 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:57.283413 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6faee7e0-b623-463e-9df5-fb7f22d2b831 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:57.283845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6faee7e0-b623-463e-9df5-fb7f22d2b831 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:57.284583 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6faee7e0-b623-463e-9df5-fb7f22d2b831 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:57.285031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6faee7e0-b623-463e-9df5-fb7f22d2b831 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:57.285453 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6faee7e0-b623-463e-9df5-fb7f22d2b831 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:57.418323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6faee7e0-b623-463e-9df5-fb7f22d2b831 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:57.427350 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6faee7e0-b623-463e-9df5-fb7f22d2b831 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.155753 Aug 24 05:49:57.427350 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 291/580] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:57 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:58.448960 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ae814251-6697-46d3-9649-8d5562dc115a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:58.449567 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ae814251-6697-46d3-9649-8d5562dc115a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:58.456575 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae814251-6697-46d3-9649-8d5562dc115a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:58.457061 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae814251-6697-46d3-9649-8d5562dc115a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:58.457503 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae814251-6697-46d3-9649-8d5562dc115a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:58.458189 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae814251-6697-46d3-9649-8d5562dc115a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:58.458638 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae814251-6697-46d3-9649-8d5562dc115a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:58.459058 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ae814251-6697-46d3-9649-8d5562dc115a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:58.600462 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ae814251-6697-46d3-9649-8d5562dc115a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:58.609470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ae814251-6697-46d3-9649-8d5562dc115a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.164451 Aug 24 05:49:58.610059 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 290/581] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:58 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:59.632127 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-41f705c3-a8e1-4f4e-819b-f5b4cd05416d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:59.632862 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-41f705c3-a8e1-4f4e-819b-f5b4cd05416d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:59.639957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-41f705c3-a8e1-4f4e-819b-f5b4cd05416d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:59.640179 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-41f705c3-a8e1-4f4e-819b-f5b4cd05416d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:59.640655 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-41f705c3-a8e1-4f4e-819b-f5b4cd05416d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:59.641359 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-41f705c3-a8e1-4f4e-819b-f5b4cd05416d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:59.641816 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-41f705c3-a8e1-4f4e-819b-f5b4cd05416d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:59.642241 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-41f705c3-a8e1-4f4e-819b-f5b4cd05416d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:59.794121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-41f705c3-a8e1-4f4e-819b-f5b4cd05416d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:59.803590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-41f705c3-a8e1-4f4e-819b-f5b4cd05416d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1265 microversion: 2.1 time: 0.175689 Aug 24 05:49:59.804161 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 292/582] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:59 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:00.825230 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e7639445-c19f-4a63-9bd9-c2e0cff21d42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:00.825832 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e7639445-c19f-4a63-9bd9-c2e0cff21d42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:00.832732 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7639445-c19f-4a63-9bd9-c2e0cff21d42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:00.833223 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7639445-c19f-4a63-9bd9-c2e0cff21d42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:00.833659 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7639445-c19f-4a63-9bd9-c2e0cff21d42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:00.834362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7639445-c19f-4a63-9bd9-c2e0cff21d42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:00.834821 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7639445-c19f-4a63-9bd9-c2e0cff21d42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:00.835243 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7639445-c19f-4a63-9bd9-c2e0cff21d42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:00.976558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e7639445-c19f-4a63-9bd9-c2e0cff21d42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:00.985867 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e7639445-c19f-4a63-9bd9-c2e0cff21d42 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1452 microversion: 2.1 time: 0.164535 Aug 24 05:50:00.986447 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 291/583] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:00 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:01.007425 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c285e882-4d7e-4aa0-ade2-b53981fa835c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:01.008056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c285e882-4d7e-4aa0-ade2-b53981fa835c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:01.014789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c285e882-4d7e-4aa0-ade2-b53981fa835c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.015274 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c285e882-4d7e-4aa0-ade2-b53981fa835c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.015707 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c285e882-4d7e-4aa0-ade2-b53981fa835c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.016391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c285e882-4d7e-4aa0-ade2-b53981fa835c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.016865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c285e882-4d7e-4aa0-ade2-b53981fa835c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.017289 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c285e882-4d7e-4aa0-ade2-b53981fa835c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.151466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c285e882-4d7e-4aa0-ade2-b53981fa835c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:01.160248 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c285e882-4d7e-4aa0-ade2-b53981fa835c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1452 microversion: 2.1 time: 0.156648 Aug 24 05:50:01.160854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 293/584] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:01 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:01.658564 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8a384334-c0e9-44e8-a6d7-32b84e139a60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:01.661887 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8a384334-c0e9-44e8-a6d7-32b84e139a60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:01.665400 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a384334-c0e9-44e8-a6d7-32b84e139a60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.665923 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a384334-c0e9-44e8-a6d7-32b84e139a60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.666358 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a384334-c0e9-44e8-a6d7-32b84e139a60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.667088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a384334-c0e9-44e8-a6d7-32b84e139a60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.667601 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a384334-c0e9-44e8-a6d7-32b84e139a60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.668022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a384334-c0e9-44e8-a6d7-32b84e139a60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.697362 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8a384334-c0e9-44e8-a6d7-32b84e139a60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/ips" status: 200 len: 151 microversion: 2.20 time: 0.043284 Aug 24 05:50:01.698028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 292/585] 10.222.0.15 () {60 vars in 1289 bytes} [Wed Aug 24 05:50:01 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:50:03.518343 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-28100acf-bbac-4469-81c2-f0fdc11a0731 req-d8ec17e4-98d4-40e2-a135-6847a3980c31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97293205-ac16-434c-bdc0-12c736460ba3", "tag": "c624c6e8-1b3d-4eb1-9e25-5d73924aaefa"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:03.533182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-28100acf-bbac-4469-81c2-f0fdc11a0731 req-d8ec17e4-98d4-40e2-a135-6847a3980c31 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:03.534042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-28100acf-bbac-4469-81c2-f0fdc11a0731 req-d8ec17e4-98d4-40e2-a135-6847a3980c31 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:03.534818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-28100acf-bbac-4469-81c2-f0fdc11a0731 req-d8ec17e4-98d4-40e2-a135-6847a3980c31 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:03.548525 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-28100acf-bbac-4469-81c2-f0fdc11a0731 req-d8ec17e4-98d4-40e2-a135-6847a3980c31 service nova] Creating event network-changed:c624c6e8-1b3d-4eb1-9e25-5d73924aaefa for instance 97293205-ac16-434c-bdc0-12c736460ba3 on hv-cinder-85426 Aug 24 05:50:03.553886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-28100acf-bbac-4469-81c2-f0fdc11a0731 req-d8ec17e4-98d4-40e2-a135-6847a3980c31 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185179 Aug 24 05:50:03.554854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 294/586] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:05.028618 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-08fc28d1-ca90-4248-b3ab-e352e70ce589 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:05.029333 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-08fc28d1-ca90-4248-b3ab-e352e70ce589 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:05.036015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08fc28d1-ca90-4248-b3ab-e352e70ce589 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:05.036535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08fc28d1-ca90-4248-b3ab-e352e70ce589 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:05.036968 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08fc28d1-ca90-4248-b3ab-e352e70ce589 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:05.037663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08fc28d1-ca90-4248-b3ab-e352e70ce589 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:05.038110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08fc28d1-ca90-4248-b3ab-e352e70ce589 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:05.038533 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08fc28d1-ca90-4248-b3ab-e352e70ce589 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:05.063361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-08fc28d1-ca90-4248-b3ab-e352e70ce589 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lazy-loading 'flavor' on Instance uuid 27d92fba-9c39-4b5f-971f-83d972055316 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:50:05.529898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-08fc28d1-ca90-4248-b3ab-e352e70ce589 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "POST /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/action" status: 202 len: 0 microversion: 2.20 time: 0.505390 Aug 24 05:50:05.531176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 293/587] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 24 05:50:05 2022] POST /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:50:05.540867 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:05.541560 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:05.548947 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:05.549436 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:05.549921 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:05.550731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:05.551180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:05.551598 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:05.692267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:05.700874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:05.703031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:05.704214 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-66d37df6-1a1f-4048-9cbe-bb9f67c666de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.168216 Aug 24 05:50:05.704808 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 295/588] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:05 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:06.727904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:06.728624 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:06.735868 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:06.736380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:06.736846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:06.737544 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:06.738004 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:06.738439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:06.885750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:06.896017 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:06.897709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:06.898889 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f182cf20-5324-409a-bbd7-e546da28c4db tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.175774 Aug 24 05:50:06.899786 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 294/589] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:06 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:07.923405 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:07.923967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:07.930353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:07.930828 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:07.931262 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:07.931947 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:07.932420 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:07.932871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:08.066263 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:08.074540 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:08.076062 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:08.077494 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c022ed42-18ba-4fa1-ba02-3d51932fbb8a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.158916 Aug 24 05:50:08.078053 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 296/590] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:07 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:09.101597 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:09.102197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:09.109528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:09.110012 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:09.110457 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:09.111151 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:09.111607 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:09.112034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:09.259947 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:09.268594 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:09.270094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:09.271248 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d719fbb3-4e23-4382-9f3c-6bc3eb977558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.173598 Aug 24 05:50:09.271807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 295/591] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:09 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:10.294235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:10.295107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:10.302453 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:10.302937 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:10.303465 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:10.304162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:10.304645 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:10.305075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:10.438389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:10.446634 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:10.448140 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:10.449324 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-05ad34c4-32c1-4f86-866b-de8da05ab39e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.159162 Aug 24 05:50:10.449883 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 297/592] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:10 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:11.471862 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:11.472497 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:11.479092 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:11.479578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:11.480022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:11.480757 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:11.481217 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:11.481650 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:11.619853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:11.631270 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:11.632813 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:11.633986 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8e1c9bda-d60f-41da-a9a4-0da5fded2f0d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.166251 Aug 24 05:50:11.634549 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 296/593] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:11 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:12.658230 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:12.658863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:12.665500 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:12.665982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:12.666410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:12.667114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:12.667559 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:12.667975 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:12.809099 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:12.817606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:12.819118 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:12.820277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ae80c5c3-8d8f-48b3-aa00-e24d7f49688b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.166930 Aug 24 05:50:12.820880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 298/594] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:12 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:13.845730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:13.846374 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:13.852687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:13.853167 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:13.853599 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:13.854293 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:13.854737 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:13.855154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:13.985428 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:13.993650 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:13.995160 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:13.996311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-47fd4330-dfbe-4185-9bb2-2e242e0538f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.155222 Aug 24 05:50:13.996894 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 297/595] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:13 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:15.018822 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:15.019429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:15.025875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:15.026358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:15.026790 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:15.027472 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:15.027922 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:15.028343 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:15.032386 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=92 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:15.164498 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:15.173633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:15.175123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:15.176298 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-96ef52ab-5b45-4b1b-a842-4bcf0020bdd6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.161572 Aug 24 05:50:15.176999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 299/596] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:15 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:16.199128 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:16.199766 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:16.207127 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:16.207614 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:16.208049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:16.208783 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:16.209239 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:16.209665 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:16.340758 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:16.348962 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:16.350473 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:16.351632 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-fb741776-9ee2-41f4-81ec-b32df753ce6d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.156437 Aug 24 05:50:16.352183 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 298/597] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:16 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:17.373908 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:17.374508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:17.380879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:17.381359 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:17.381793 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:17.382477 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:17.382928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:17.383352 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:17.515567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:17.524935 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:17.526591 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:17.527755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-72adef23-cb14-4fde-b89e-ebb1afba5708 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.157736 Aug 24 05:50:17.528313 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 300/598] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:17 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:18.552522 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:18.553065 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:18.559513 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:18.559995 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:18.560454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:18.561209 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:18.561665 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:18.562090 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:18.692764 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:18.700914 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:18.702422 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:18.704139 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-fb78f245-e543-4a85-959b-2f266a6f47e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.155077 Aug 24 05:50:18.704868 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 299/599] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:18 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:19.727072 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:19.727817 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:19.734411 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:19.735558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:19.736346 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:19.737077 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:19.737540 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:19.737972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:19.867106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:19.875180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:19.877242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:19.878403 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-383cc123-4073-4f76-b946-9d626d83f85e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.155391 Aug 24 05:50:19.878952 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 301/600] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:19 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:20.902470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:20.903066 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:20.910989 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:20.911494 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:20.911929 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:20.912672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:20.913131 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:20.913565 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:21.051418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:21.059695 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:21.061248 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:21.062405 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-22934523-27f5-426c-a415-64f621d8f76d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.163950 Aug 24 05:50:21.062975 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 300/601] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:20 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:22.087174 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:22.087885 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:22.090363 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=30 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:22.096330 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:22.096874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:22.097311 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:22.098013 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:22.098468 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:22.098891 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:22.235526 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:22.244264 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:22.245808 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:22.246964 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-69893713-a248-48b1-bb3b-1e78bb0cc7a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.163777 Aug 24 05:50:22.247518 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 302/602] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:22 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:23.271547 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:23.272162 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:23.278359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:23.278849 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:23.279290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:23.279999 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:23.280488 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:23.280924 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:23.287096 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:23.416045 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:23.425108 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:23.426618 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:23.427767 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7fe9e65b-e451-4e1a-9b98-e539571ada4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1743 microversion: 2.20 time: 0.161263 Aug 24 05:50:23.428328 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 301/603] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:23 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:24.451261 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:24.451794 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:24.458971 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:24.459445 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:24.459873 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:24.460580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:24.461027 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:24.461442 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:24.593512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:24.601664 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:24.603167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:24.604312 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4cb0db63-ca13-4b34-95f9-21b4b6dc8815 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1743 microversion: 2.20 time: 0.157061 Aug 24 05:50:24.604891 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 303/604] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:24 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:25.627966 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:25.628615 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:25.631016 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=30 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:25.635842 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:25.636332 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:25.636803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:25.637538 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:25.637999 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:25.638429 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:25.773614 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:25.781913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:25.783893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:25.785092 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4d3e5807-37b2-4168-8550-1c5991f68400 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1743 microversion: 2.20 time: 0.161991 Aug 24 05:50:25.785641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 302/605] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:25 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:26.809251 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:26.810031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:26.817404 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:26.817965 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:26.818406 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:26.819102 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:26.819555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:26.819974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:26.953068 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:26.961603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:26.963107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:26.964253 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9c8395cb-40c6-4fdb-849a-deea069a86c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1743 microversion: 2.20 time: 0.159101 Aug 24 05:50:26.964878 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 304/606] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:26 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:27.988828 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:27.989425 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:27.995826 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:27.996310 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:27.996788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:27.997489 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:27.997947 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:27.998417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:28.135333 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:28.143527 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:28.145078 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:28.146232 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2bd131b8-0ce4-4e16-a6d1-f14e9f31629b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1743 microversion: 2.20 time: 0.162206 Aug 24 05:50:28.146785 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 303/607] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:27 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:28.473004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-02f7521a-1553-47ca-b33d-e12c24848496 req-14abdb91-7112-4da6-8930-293e40e02dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d92fba-9c39-4b5f-971f-83d972055316", "name": "network-vif-plugged", "status": "completed", "tag": "14ce7c9b-e214-4a48-bcb6-c730bc8b2303"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:28.482913 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-02f7521a-1553-47ca-b33d-e12c24848496 req-14abdb91-7112-4da6-8930-293e40e02dd9 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:28.483382 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-02f7521a-1553-47ca-b33d-e12c24848496 req-14abdb91-7112-4da6-8930-293e40e02dd9 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:28.483805 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-02f7521a-1553-47ca-b33d-e12c24848496 req-14abdb91-7112-4da6-8930-293e40e02dd9 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:28.495324 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-02f7521a-1553-47ca-b33d-e12c24848496 req-14abdb91-7112-4da6-8930-293e40e02dd9 service nova] Creating event network-vif-plugged:14ce7c9b-e214-4a48-bcb6-c730bc8b2303 for instance 27d92fba-9c39-4b5f-971f-83d972055316 on hv-cinder-85426 Aug 24 05:50:28.500433 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-02f7521a-1553-47ca-b33d-e12c24848496 req-14abdb91-7112-4da6-8930-293e40e02dd9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088080 Aug 24 05:50:28.501008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 305/608] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:29.169197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:29.169752 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:29.177145 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:29.177634 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:29.178076 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:29.178781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:29.179244 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:29.179672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:29.312064 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:29.321071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:29.322607 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:29.323754 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-61a99d1b-3c9a-4fb8-adff-f1ee86965ad5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1743 microversion: 2.20 time: 0.158594 Aug 24 05:50:29.324298 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 304/609] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:29 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:30.348836 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:30.349520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:30.356112 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:30.356632 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:30.357067 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:30.357747 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:30.358196 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:30.358643 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:30.492502 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:30.498273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:30.499872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:30.501061 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1da3b5c8-22f7-462b-b35f-0e3924a91ef5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1743 microversion: 2.20 time: 0.157198 Aug 24 05:50:30.501630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 306/610] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:30 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:31.523389 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:31.523922 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:31.530541 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:31.531043 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:31.531479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:31.532175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:31.532664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:31.533192 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:31.675734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:31.684191 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:31.685742 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:31.686904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d9a09368-a006-4353-822e-5f8a60dfcda5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1743 microversion: 2.20 time: 0.167567 Aug 24 05:50:31.687485 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 305/611] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:31 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:50:32.710967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:32.711612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:32.718333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:32.718876 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:32.719300 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:32.720000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:32.721033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:32.725150 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:32.889775 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:32.901194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:32.907520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:32.910584 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d2b24343-21fe-43d0-b6a9-0c9171a95bab tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.203014 Aug 24 05:50:32.921855 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 307/612] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:32 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:33.935786 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:33.936308 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:33.943314 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:33.944069 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:33.944538 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:33.945243 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:33.945699 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:33.946124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:34.089274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:34.099441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:34.101120 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:34.102305 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2b6cefec-9bbd-4efe-a304-6e73a6b87146 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.170908 Aug 24 05:50:34.112415 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 306/613] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:33 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:35.128977 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:35.130536 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:35.141649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:35.142590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:35.143273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:35.145083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:35.145856 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:35.147990 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:35.433034 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:35.444334 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:35.446746 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:35.448624 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-822b9ae4-1003-46d1-94e0-75b10d0a50cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.326598 Aug 24 05:50:35.449339 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 308/614] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:35 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:36.471662 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:36.472984 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:36.479835 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:36.480372 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:36.480804 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:36.481518 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:36.481978 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:36.482406 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:36.629950 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:36.639933 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:36.641457 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:36.643801 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1d1f6c6a-a843-4c56-988c-cc937690d329 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.176057 Aug 24 05:50:36.645211 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 307/615] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:36 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:37.667382 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:37.668028 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:37.675545 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:37.676033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:37.678307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:37.678307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:37.678307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:37.678307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:37.822464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:37.832093 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:37.833641 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:37.834804 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d5cd00a2-3443-48c8-abd3-0ec88d789aa1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.171400 Aug 24 05:50:37.835365 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 309/616] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:37 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:38.858244 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:38.859068 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:38.866542 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:38.866910 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:38.867562 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:38.868046 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:38.868536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:38.868967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:39.011743 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:39.024382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:39.025915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:39.027081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-73026eae-663c-497b-bf23-76931de4e068 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.172766 Aug 24 05:50:39.027633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 308/617] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:38 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:40.052314 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:40.053212 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:40.060156 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:40.060731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:40.061177 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:40.062030 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:40.062592 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:40.062999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:40.202491 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:40.214761 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:40.216364 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:40.217660 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-59e351f7-e936-4f9c-9a95-ffdf8922a595 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.170328 Aug 24 05:50:40.218227 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 310/618] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:40 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:41.242852 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:41.243648 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:41.249814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:41.250294 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:41.250729 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:41.251410 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:41.251858 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:41.252277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:41.394763 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:41.402613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d38d4f03-6bfa-4b83-9d75-3eff8afd65c2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1c66e97-1bff-4aa8-bd0f-f5e97b527934"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:41.404948 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:41.405202 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d38d4f03-6bfa-4b83-9d75-3eff8afd65c2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:41.407306 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:41.408560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e2d00234-ae8f-4dbd-8151-78294db60623 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.170740 Aug 24 05:50:41.412139 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d38d4f03-6bfa-4b83-9d75-3eff8afd65c2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:41.412661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d38d4f03-6bfa-4b83-9d75-3eff8afd65c2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:41.413106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d38d4f03-6bfa-4b83-9d75-3eff8afd65c2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:41.413812 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d38d4f03-6bfa-4b83-9d75-3eff8afd65c2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:41.414280 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d38d4f03-6bfa-4b83-9d75-3eff8afd65c2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:41.414721 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d38d4f03-6bfa-4b83-9d75-3eff8afd65c2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:41.422664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 309/619] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:41 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:42.296272 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d38d4f03-6bfa-4b83-9d75-3eff8afd65c2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "POST /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.026910 Aug 24 05:50:42.296860 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 311/620] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 05:50:41 2022] POST /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments => generated 194 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:42.446037 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:42.453054 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:42.473257 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:42.474208 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:42.474974 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:42.476281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:42.477120 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:42.478002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:42.668159 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:42.677583 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:42.679131 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:42.680305 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-641041eb-52b4-4411-bccf-3df927deef38 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.244689 Aug 24 05:50:42.680896 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 310/621] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:42 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:43.704489 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:43.705208 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:43.712538 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:43.713293 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:43.713729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:43.714446 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:43.714912 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:43.715329 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:43.875968 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:43.886259 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:43.887766 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:43.888967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a83e4af7-3832-4d40-8521-42c77e901230 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.189458 Aug 24 05:50:43.893082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 312/622] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:43 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:44.913053 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:44.913662 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:44.920541 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:44.921034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:44.921482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:44.922172 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:44.922628 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:44.923057 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:45.063821 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:45.072562 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:45.074085 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:45.075254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e2bad05d-49e8-4b1a-837b-d4ab80bd3676 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.166456 Aug 24 05:50:45.075799 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 311/623] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:44 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:46.099235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:46.099895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:46.106527 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:46.107015 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:46.107452 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:46.108246 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:46.108734 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:46.109163 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:46.111930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:46.243357 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:46.251533 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:46.253198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:46.254856 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-71506c2a-ef65-4baa-af74-0dfe08ee73d8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.159684 Aug 24 05:50:46.255447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 313/624] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:46 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:47.278975 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:47.279625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:47.286307 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:47.286862 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:47.287305 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:47.288143 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:47.288627 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:47.289062 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:47.419538 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:47.429705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:47.431234 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:47.432435 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-af153ca2-03ac-4659-8a0e-2c8f7e3b0cf7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1738 microversion: 2.20 time: 0.157497 Aug 24 05:50:47.432993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 312/625] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:47 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:48.455238 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:48.455875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:48.463165 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:48.463640 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:48.464069 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:48.464787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:48.465235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:48.465660 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:48.604140 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:48.612259 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:48.614275 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:48.615585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2b8ba0b1-fe18-40a3-9504-d611ff747f7b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1720 microversion: 2.20 time: 0.164125 Aug 24 05:50:48.616145 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 314/626] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:48 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:49.639585 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:49.640582 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:49.647996 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:49.648507 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:49.648949 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:49.649653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:49.650113 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:49.650542 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:49.783627 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:49.792890 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:49.794414 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:49.795847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0ff20eeb-a43a-4303-9165-3021a6d83c8e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1720 microversion: 2.20 time: 0.160653 Aug 24 05:50:49.796426 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 313/627] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:49 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:50.482997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-8fe57cac-a35a-427e-94e8-406788b6fc64 req-c953cb4d-0683-4e45-8f9f-728ce17f58c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d92fba-9c39-4b5f-971f-83d972055316", "name": "network-vif-unplugged", "status": "completed", "tag": "14ce7c9b-e214-4a48-bcb6-c730bc8b2303"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:50.494349 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-8fe57cac-a35a-427e-94e8-406788b6fc64 req-c953cb4d-0683-4e45-8f9f-728ce17f58c5 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:50.494841 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-8fe57cac-a35a-427e-94e8-406788b6fc64 req-c953cb4d-0683-4e45-8f9f-728ce17f58c5 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:50.495290 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-8fe57cac-a35a-427e-94e8-406788b6fc64 req-c953cb4d-0683-4e45-8f9f-728ce17f58c5 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:50.506587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-8fe57cac-a35a-427e-94e8-406788b6fc64 req-c953cb4d-0683-4e45-8f9f-728ce17f58c5 service nova] Creating event network-vif-unplugged:14ce7c9b-e214-4a48-bcb6-c730bc8b2303 for instance 27d92fba-9c39-4b5f-971f-83d972055316 on hv-cinder-85426 Aug 24 05:50:50.511674 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-8fe57cac-a35a-427e-94e8-406788b6fc64 req-c953cb4d-0683-4e45-8f9f-728ce17f58c5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032365 Aug 24 05:50:50.512260 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 315/628] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:50.818877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:50.819848 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:50.826476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:50.826962 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:50.827417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:50.828095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:50.828589 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:50.829020 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:50.971095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:50.980765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:50.982291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:50.983448 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b7c72953-78fb-4d46-9159-fe2e4efd5e1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1720 microversion: 2.20 time: 0.168673 Aug 24 05:50:50.984007 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 314/629] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:50 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:50:52.007874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:52.008519 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:52.014772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:52.015256 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:52.015694 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:52.016390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:52.016870 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:52.017303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:52.147469 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:52.155720 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:52.157278 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:52.158501 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5d2bcb58-b94f-495e-886a-cdba18e93adf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1720 microversion: 2.20 time: 0.155600 Aug 24 05:50:52.159148 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 316/630] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:52 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:53.040259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e761f53c-b799-4519-afd0-a8ce83191e8c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:53.042678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e761f53c-b799-4519-afd0-a8ce83191e8c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:53.049698 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e761f53c-b799-4519-afd0-a8ce83191e8c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:53.050191 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e761f53c-b799-4519-afd0-a8ce83191e8c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:53.050636 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e761f53c-b799-4519-afd0-a8ce83191e8c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:53.051337 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e761f53c-b799-4519-afd0-a8ce83191e8c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:53.051804 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e761f53c-b799-4519-afd0-a8ce83191e8c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:53.052284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e761f53c-b799-4519-afd0-a8ce83191e8c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:53.076467 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-e761f53c-b799-4519-afd0-a8ce83191e8c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lazy-loading 'flavor' on Instance uuid 64eb4995-d137-42b3-96b4-1af57d704189 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:50:53.185676 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:53.186972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:53.190701 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=30 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:53.209868 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:53.209868 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:53.209868 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:53.209868 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:53.210334 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:53.210334 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:53.329736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:53.339913 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:53.341803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:53.342686 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9e23065a-e836-4fa1-a1f7-02e7a1d83a0c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1723 microversion: 2.20 time: 0.163329 Aug 24 05:50:53.343274 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 317/631] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:53 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:53.358894 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:53.365987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a4bd1990-805a-43b7-aa30-8e47dbe31c4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9ae71a6-fb3a-4104-af76-b3c9906fcc8b"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:53.368282 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a4bd1990-805a-43b7-aa30-8e47dbe31c4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:53.374255 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4bd1990-805a-43b7-aa30-8e47dbe31c4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:53.374739 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4bd1990-805a-43b7-aa30-8e47dbe31c4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:53.375174 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4bd1990-805a-43b7-aa30-8e47dbe31c4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:53.375859 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4bd1990-805a-43b7-aa30-8e47dbe31c4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:53.376315 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4bd1990-805a-43b7-aa30-8e47dbe31c4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:53.376833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4bd1990-805a-43b7-aa30-8e47dbe31c4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:53.439407 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e761f53c-b799-4519-afd0-a8ce83191e8c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "POST /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/action" status: 200 len: 32 microversion: 2.1 time: 0.403965 Aug 24 05:50:53.440003 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 315/632] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:50:53 2022] POST /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/action => generated 32 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:50:53.450947 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1346bb04-8d1b-438f-8612-c48db55a83ef tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:53.451608 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1346bb04-8d1b-438f-8612-c48db55a83ef tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:53.461851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1346bb04-8d1b-438f-8612-c48db55a83ef tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:53.462439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1346bb04-8d1b-438f-8612-c48db55a83ef tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:53.462880 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1346bb04-8d1b-438f-8612-c48db55a83ef tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:53.463589 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1346bb04-8d1b-438f-8612-c48db55a83ef tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:53.464100 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1346bb04-8d1b-438f-8612-c48db55a83ef tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:53.464575 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1346bb04-8d1b-438f-8612-c48db55a83ef tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:53.600713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1346bb04-8d1b-438f-8612-c48db55a83ef tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:53.609164 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1346bb04-8d1b-438f-8612-c48db55a83ef tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.162946 Aug 24 05:50:53.609750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 316/633] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:53 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:54.409180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a4bd1990-805a-43b7-aa30-8e47dbe31c4a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "POST /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.047191 Aug 24 05:50:54.409812 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 318/634] 10.222.0.15 () {62 vars in 1364 bytes} [Wed Aug 24 05:50:53 2022] POST /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments => generated 188 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:50:54.535294 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f21be073-902c-4ff0-b0f9-d2c2e7580ae4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:54.536154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f21be073-902c-4ff0-b0f9-d2c2e7580ae4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:54.543551 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f21be073-902c-4ff0-b0f9-d2c2e7580ae4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:54.544069 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f21be073-902c-4ff0-b0f9-d2c2e7580ae4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:54.544545 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f21be073-902c-4ff0-b0f9-d2c2e7580ae4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:54.545498 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f21be073-902c-4ff0-b0f9-d2c2e7580ae4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:54.545983 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f21be073-902c-4ff0-b0f9-d2c2e7580ae4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:54.546411 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f21be073-902c-4ff0-b0f9-d2c2e7580ae4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:54.630110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b9b491fc-9333-4674-bea6-9f31bf07752c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:54.630993 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b9b491fc-9333-4674-bea6-9f31bf07752c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:54.637879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9b491fc-9333-4674-bea6-9f31bf07752c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:54.638095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f21be073-902c-4ff0-b0f9-d2c2e7580ae4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127755) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:50:54.638395 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9b491fc-9333-4674-bea6-9f31bf07752c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:54.638937 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9b491fc-9333-4674-bea6-9f31bf07752c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:54.639650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9b491fc-9333-4674-bea6-9f31bf07752c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:54.640112 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9b491fc-9333-4674-bea6-9f31bf07752c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:54.640571 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b9b491fc-9333-4674-bea6-9f31bf07752c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:54.771132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b9b491fc-9333-4674-bea6-9f31bf07752c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:54.780126 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b9b491fc-9333-4674-bea6-9f31bf07752c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.153944 Aug 24 05:50:54.780824 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 319/635] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:54 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:54.968211 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f21be073-902c-4ff0-b0f9-d2c2e7580ae4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "POST /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/action" status: 202 len: 0 microversion: 2.20 time: 0.437035 Aug 24 05:50:54.969037 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 317/636] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 24 05:50:54 2022] POST /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:50:54.977701 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:54.978311 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:54.984468 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:54.984954 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:54.985391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:54.986084 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:54.986590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:54.987012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:55.125085 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:55.135071 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:55.136840 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:55.138091 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-178f5451-48ea-4e95-bb90-da23e156598e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1749 microversion: 2.20 time: 0.164824 Aug 24 05:50:55.138742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 320/637] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:54 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:55.802258 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e46d9d63-5815-4ac2-84b3-e04477f80761 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:55.803170 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e46d9d63-5815-4ac2-84b3-e04477f80761 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:55.805701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:55.810617 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e46d9d63-5815-4ac2-84b3-e04477f80761 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:55.811091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e46d9d63-5815-4ac2-84b3-e04477f80761 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:55.811530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e46d9d63-5815-4ac2-84b3-e04477f80761 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:55.812227 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e46d9d63-5815-4ac2-84b3-e04477f80761 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:55.812734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e46d9d63-5815-4ac2-84b3-e04477f80761 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:55.815102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e46d9d63-5815-4ac2-84b3-e04477f80761 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:55.955407 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e46d9d63-5815-4ac2-84b3-e04477f80761 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:55.964974 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e46d9d63-5815-4ac2-84b3-e04477f80761 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.166597 Aug 24 05:50:55.965671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 318/638] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:55 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:56.161640 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:56.162566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:56.169190 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:56.169701 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:56.170131 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:56.171094 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:56.171543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:56.173295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:56.317059 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:56.326772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:56.328283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:56.329471 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-aafbf4b5-6988-4803-9180-3eae4651be34 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1749 microversion: 2.20 time: 0.172188 Aug 24 05:50:56.330033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 321/639] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:56 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:56.986078 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3ca6b665-4324-45c4-a130-c5368283f1ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:56.986677 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3ca6b665-4324-45c4-a130-c5368283f1ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:56.993040 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3ca6b665-4324-45c4-a130-c5368283f1ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:56.993514 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3ca6b665-4324-45c4-a130-c5368283f1ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:56.993949 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3ca6b665-4324-45c4-a130-c5368283f1ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:56.994628 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3ca6b665-4324-45c4-a130-c5368283f1ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:56.995077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3ca6b665-4324-45c4-a130-c5368283f1ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:56.995499 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3ca6b665-4324-45c4-a130-c5368283f1ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:57.123600 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3ca6b665-4324-45c4-a130-c5368283f1ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:57.131747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3ca6b665-4324-45c4-a130-c5368283f1ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.149576 Aug 24 05:50:57.132309 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 319/640] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:56 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:57.354279 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:57.354986 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:57.361337 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:57.361822 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:57.362258 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:57.362946 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:57.363406 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:57.363837 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:57.498235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:57.507587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:57.509125 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:57.510363 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0d62ebe8-5def-4557-984f-3030f32651da tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1751 microversion: 2.20 time: 0.160248 Aug 24 05:50:57.510918 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 322/641] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:57 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:58.153370 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b66045e0-c438-4d7c-bee8-f62c221f53e1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:58.153959 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b66045e0-c438-4d7c-bee8-f62c221f53e1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:58.160315 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b66045e0-c438-4d7c-bee8-f62c221f53e1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:58.160826 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b66045e0-c438-4d7c-bee8-f62c221f53e1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:58.161257 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b66045e0-c438-4d7c-bee8-f62c221f53e1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:58.162059 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b66045e0-c438-4d7c-bee8-f62c221f53e1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:58.162579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b66045e0-c438-4d7c-bee8-f62c221f53e1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:58.162997 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b66045e0-c438-4d7c-bee8-f62c221f53e1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:58.295644 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b66045e0-c438-4d7c-bee8-f62c221f53e1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:58.305433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b66045e0-c438-4d7c-bee8-f62c221f53e1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.155894 Aug 24 05:50:58.306013 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 320/642] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:58 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:58.533715 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:58.534305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:58.541503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:58.546310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:58.546310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:58.546310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:58.546310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:58.546687 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:58.674617 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:58.684045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:58.685593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:58.686742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f7ae7842-acb0-4de7-acc4-fe67540bb373 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.157005 Aug 24 05:50:58.687298 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 323/643] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:58 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:59.327171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-5f1bb993-0c47-4dfd-a225-779fa15b28ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:59.327888 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5f1bb993-0c47-4dfd-a225-779fa15b28ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:59.334587 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5f1bb993-0c47-4dfd-a225-779fa15b28ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:59.335077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5f1bb993-0c47-4dfd-a225-779fa15b28ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:59.335521 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5f1bb993-0c47-4dfd-a225-779fa15b28ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:59.336219 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5f1bb993-0c47-4dfd-a225-779fa15b28ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:59.336710 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5f1bb993-0c47-4dfd-a225-779fa15b28ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:59.337140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5f1bb993-0c47-4dfd-a225-779fa15b28ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:59.370195 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e85b3593-76b4-4f1c-82b4-ae57425f9cf4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:59.372477 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e85b3593-76b4-4f1c-82b4-ae57425f9cf4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:59.378472 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e85b3593-76b4-4f1c-82b4-ae57425f9cf4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:59.379050 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e85b3593-76b4-4f1c-82b4-ae57425f9cf4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:59.379385 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e85b3593-76b4-4f1c-82b4-ae57425f9cf4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:59.380086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e85b3593-76b4-4f1c-82b4-ae57425f9cf4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:59.380578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e85b3593-76b4-4f1c-82b4-ae57425f9cf4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:59.381580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e85b3593-76b4-4f1c-82b4-ae57425f9cf4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:59.475837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5f1bb993-0c47-4dfd-a225-779fa15b28ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:59.484093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-5f1bb993-0c47-4dfd-a225-779fa15b28ce tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.160992 Aug 24 05:50:59.484718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 321/644] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:59 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:59.624795 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e85b3593-76b4-4f1c-82b4-ae57425f9cf4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "POST /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/action" status: 202 len: 0 microversion: 2.1 time: 0.258290 Aug 24 05:50:59.625465 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 324/645] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:50:59 2022] POST /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:50:59.633800 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b8bbf2ec-cb84-496d-a438-a73c1726f6ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:59.634439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b8bbf2ec-cb84-496d-a438-a73c1726f6ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:59.640806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b8bbf2ec-cb84-496d-a438-a73c1726f6ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:59.641295 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b8bbf2ec-cb84-496d-a438-a73c1726f6ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:59.641737 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b8bbf2ec-cb84-496d-a438-a73c1726f6ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:59.642440 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b8bbf2ec-cb84-496d-a438-a73c1726f6ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:59.642903 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b8bbf2ec-cb84-496d-a438-a73c1726f6ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:59.643326 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b8bbf2ec-cb84-496d-a438-a73c1726f6ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:59.710638 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:59.711383 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:59.718526 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:59.719030 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:59.719468 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:59.721188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:59.721188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:59.721426 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:59.877689 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b8bbf2ec-cb84-496d-a438-a73c1726f6ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:59.887013 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b8bbf2ec-cb84-496d-a438-a73c1726f6ec tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.257331 Aug 24 05:50:59.887596 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 322/646] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:59 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:59.984499 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:59.995538 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:59.997044 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:59.998228 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-66ba3637-53f8-4b8b-a44b-e9a86b329764 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.292064 Aug 24 05:50:59.998785 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 325/647] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:59 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:00.506885 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e1a56caa-4b2f-4137-a699-90986c1e7eb9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:00.508014 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e1a56caa-4b2f-4137-a699-90986c1e7eb9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:00.514521 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1a56caa-4b2f-4137-a699-90986c1e7eb9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:00.515012 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1a56caa-4b2f-4137-a699-90986c1e7eb9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:00.515451 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1a56caa-4b2f-4137-a699-90986c1e7eb9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:00.516367 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1a56caa-4b2f-4137-a699-90986c1e7eb9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:00.516866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1a56caa-4b2f-4137-a699-90986c1e7eb9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:00.517467 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1a56caa-4b2f-4137-a699-90986c1e7eb9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:00.658481 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e1a56caa-4b2f-4137-a699-90986c1e7eb9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:00.673017 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e1a56caa-4b2f-4137-a699-90986c1e7eb9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.170447 Aug 24 05:51:00.684419 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 323/648] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:00 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:00.909481 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4b4f1d01-8f30-4669-92c2-1d8e8e4655be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:00.913510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4b4f1d01-8f30-4669-92c2-1d8e8e4655be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:00.917610 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b4f1d01-8f30-4669-92c2-1d8e8e4655be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:00.918102 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b4f1d01-8f30-4669-92c2-1d8e8e4655be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:00.918593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b4f1d01-8f30-4669-92c2-1d8e8e4655be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:00.919295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b4f1d01-8f30-4669-92c2-1d8e8e4655be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:00.919755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b4f1d01-8f30-4669-92c2-1d8e8e4655be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:00.920187 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b4f1d01-8f30-4669-92c2-1d8e8e4655be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.029445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:01.030055 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:01.035947 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.036458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.037481 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.038183 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.038630 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.039048 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.072762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4b4f1d01-8f30-4669-92c2-1d8e8e4655be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:01.075472 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:01.096567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4b4f1d01-8f30-4669-92c2-1d8e8e4655be tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.191091 Aug 24 05:51:01.102356 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 326/649] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:00 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:01.188707 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:01.198553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:01.200071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:01.201304 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-76a07d22-d06e-474b-a0b1-7cb6d4c56f1f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.175744 Aug 24 05:51:01.212788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 324/650] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:01 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:01.696011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1d7d34ba-d0c9-40c7-bc69-e91a74129dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:01.696683 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1d7d34ba-d0c9-40c7-bc69-e91a74129dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:01.703382 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d7d34ba-d0c9-40c7-bc69-e91a74129dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.703869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d7d34ba-d0c9-40c7-bc69-e91a74129dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.704310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d7d34ba-d0c9-40c7-bc69-e91a74129dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.705027 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d7d34ba-d0c9-40c7-bc69-e91a74129dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.705487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d7d34ba-d0c9-40c7-bc69-e91a74129dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.705926 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1d7d34ba-d0c9-40c7-bc69-e91a74129dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.840040 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1d7d34ba-d0c9-40c7-bc69-e91a74129dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:01.848677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1d7d34ba-d0c9-40c7-bc69-e91a74129dde tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.157422 Aug 24 05:51:01.849518 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 327/651] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:01 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:02.120019 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-03e3cb42-747e-4432-b1d0-3a772d47ea9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:02.121964 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-03e3cb42-747e-4432-b1d0-3a772d47ea9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:02.129042 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-03e3cb42-747e-4432-b1d0-3a772d47ea9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:02.129866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-03e3cb42-747e-4432-b1d0-3a772d47ea9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:02.130506 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-03e3cb42-747e-4432-b1d0-3a772d47ea9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:02.132241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-03e3cb42-747e-4432-b1d0-3a772d47ea9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:02.132805 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-03e3cb42-747e-4432-b1d0-3a772d47ea9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:02.133293 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-03e3cb42-747e-4432-b1d0-3a772d47ea9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:02.226219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:02.227512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:02.242925 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:02.243421 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:02.243854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:02.244675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:02.245130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:02.245546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:02.303089 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-03e3cb42-747e-4432-b1d0-3a772d47ea9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:02.311950 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-03e3cb42-747e-4432-b1d0-3a772d47ea9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.196101 Aug 24 05:51:02.312833 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 325/652] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:02 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:02.398277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:02.407094 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:02.408632 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:02.409765 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c883d975-8836-4158-bbca-3cf526e342e8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.187750 Aug 24 05:51:02.410314 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 328/653] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:02 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:02.870138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-64afba71-b7d2-420e-8d67-fd3fca289c8d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:02.870907 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-64afba71-b7d2-420e-8d67-fd3fca289c8d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:02.878198 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-64afba71-b7d2-420e-8d67-fd3fca289c8d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:02.878702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-64afba71-b7d2-420e-8d67-fd3fca289c8d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:02.879141 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-64afba71-b7d2-420e-8d67-fd3fca289c8d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:02.879860 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-64afba71-b7d2-420e-8d67-fd3fca289c8d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:02.880322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-64afba71-b7d2-420e-8d67-fd3fca289c8d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:02.880970 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-64afba71-b7d2-420e-8d67-fd3fca289c8d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.034767 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-64afba71-b7d2-420e-8d67-fd3fca289c8d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:03.045236 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-64afba71-b7d2-420e-8d67-fd3fca289c8d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.178951 Aug 24 05:51:03.046450 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 326/654] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:02 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:03.338230 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-92d928ab-082e-4fcf-9e73-4e2888c4afb9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:03.339041 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-92d928ab-082e-4fcf-9e73-4e2888c4afb9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:03.345656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92d928ab-082e-4fcf-9e73-4e2888c4afb9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.346217 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92d928ab-082e-4fcf-9e73-4e2888c4afb9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.346724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92d928ab-082e-4fcf-9e73-4e2888c4afb9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.347557 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92d928ab-082e-4fcf-9e73-4e2888c4afb9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.348011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92d928ab-082e-4fcf-9e73-4e2888c4afb9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.348464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92d928ab-082e-4fcf-9e73-4e2888c4afb9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.433473 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:03.434177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:03.445241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.447499 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.447978 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.448955 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.449864 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.449864 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.512000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-92d928ab-082e-4fcf-9e73-4e2888c4afb9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:03.525433 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-92d928ab-082e-4fcf-9e73-4e2888c4afb9 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.192565 Aug 24 05:51:03.526118 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 329/655] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:03 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:03.610525 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:03.619780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:03.621355 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:03.622559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b594bd41-7dce-4d0f-9291-b4b6d4042cdf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.193039 Aug 24 05:51:03.623227 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 327/656] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:03 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:04.070555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-093805bd-a3a8-479e-85a8-1a57b3e8cf44 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:04.071071 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-093805bd-a3a8-479e-85a8-1a57b3e8cf44 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:04.077317 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-093805bd-a3a8-479e-85a8-1a57b3e8cf44 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:04.077798 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-093805bd-a3a8-479e-85a8-1a57b3e8cf44 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:04.078231 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-093805bd-a3a8-479e-85a8-1a57b3e8cf44 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:04.078906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-093805bd-a3a8-479e-85a8-1a57b3e8cf44 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:04.079354 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-093805bd-a3a8-479e-85a8-1a57b3e8cf44 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:04.079773 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-093805bd-a3a8-479e-85a8-1a57b3e8cf44 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:04.216825 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-093805bd-a3a8-479e-85a8-1a57b3e8cf44 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:04.225436 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-093805bd-a3a8-479e-85a8-1a57b3e8cf44 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.159228 Aug 24 05:51:04.225995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 330/657] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:04 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:04.547925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4af388aa-a0aa-42df-9c1d-2255262f37f0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:04.548557 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4af388aa-a0aa-42df-9c1d-2255262f37f0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:04.555172 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af388aa-a0aa-42df-9c1d-2255262f37f0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:04.555648 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af388aa-a0aa-42df-9c1d-2255262f37f0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:04.556082 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af388aa-a0aa-42df-9c1d-2255262f37f0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:04.556803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af388aa-a0aa-42df-9c1d-2255262f37f0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:04.557257 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af388aa-a0aa-42df-9c1d-2255262f37f0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:04.557679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af388aa-a0aa-42df-9c1d-2255262f37f0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:04.646591 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:04.647175 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:04.654166 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:04.654655 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:04.655090 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:04.655794 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:04.656249 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:04.656702 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:04.719503 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4af388aa-a0aa-42df-9c1d-2255262f37f0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:04.728872 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4af388aa-a0aa-42df-9c1d-2255262f37f0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.184911 Aug 24 05:51:04.729714 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 328/658] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:04 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:04.824858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:04.833446 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:04.835802 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:04.836999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0071e4be-0e58-4a86-9a6f-3997a83410e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.194836 Aug 24 05:51:04.837562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 331/659] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:04 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:05.248740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-72707d49-8665-421e-bb22-6e953949569e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:05.249651 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-72707d49-8665-421e-bb22-6e953949569e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:05.257268 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-72707d49-8665-421e-bb22-6e953949569e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:05.257770 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-72707d49-8665-421e-bb22-6e953949569e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:05.258214 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-72707d49-8665-421e-bb22-6e953949569e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:05.259013 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-72707d49-8665-421e-bb22-6e953949569e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:05.259485 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-72707d49-8665-421e-bb22-6e953949569e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:05.259918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-72707d49-8665-421e-bb22-6e953949569e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:05.422849 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-72707d49-8665-421e-bb22-6e953949569e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:05.431688 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-72707d49-8665-421e-bb22-6e953949569e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.186920 Aug 24 05:51:05.432268 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 329/660] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:05 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:05.750991 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0372abce-c07a-4a55-91aa-8fe80c758b50 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:05.751777 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0372abce-c07a-4a55-91aa-8fe80c758b50 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:05.759747 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0372abce-c07a-4a55-91aa-8fe80c758b50 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:05.760123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0372abce-c07a-4a55-91aa-8fe80c758b50 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:05.760599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0372abce-c07a-4a55-91aa-8fe80c758b50 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:05.761301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0372abce-c07a-4a55-91aa-8fe80c758b50 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:05.761752 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0372abce-c07a-4a55-91aa-8fe80c758b50 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:05.762168 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0372abce-c07a-4a55-91aa-8fe80c758b50 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:05.861964 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:05.862579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:05.871454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:05.871969 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:05.872427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:05.873150 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:05.873596 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:05.874019 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:05.979043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0372abce-c07a-4a55-91aa-8fe80c758b50 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:05.987781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0372abce-c07a-4a55-91aa-8fe80c758b50 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.240850 Aug 24 05:51:05.988587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 332/661] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:05 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:06.057203 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:06.068823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:06.070425 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:06.071936 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2a6fa259-324a-49f2-b109-1fdd6a3eced9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.214308 Aug 24 05:51:06.080442 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 330/662] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:05 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:06.456537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-147e5678-184a-4ab8-ab2c-2598e9a93ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:06.457054 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-147e5678-184a-4ab8-ab2c-2598e9a93ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:06.463767 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-147e5678-184a-4ab8-ab2c-2598e9a93ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:06.464260 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-147e5678-184a-4ab8-ab2c-2598e9a93ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:06.464727 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-147e5678-184a-4ab8-ab2c-2598e9a93ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:06.465430 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-147e5678-184a-4ab8-ab2c-2598e9a93ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:06.466161 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-147e5678-184a-4ab8-ab2c-2598e9a93ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:06.466519 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-147e5678-184a-4ab8-ab2c-2598e9a93ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:06.606390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-147e5678-184a-4ab8-ab2c-2598e9a93ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:06.614857 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-147e5678-184a-4ab8-ab2c-2598e9a93ae9 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.162191 Aug 24 05:51:06.615728 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 333/663] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:06 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:07.010809 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1619d63d-66b8-47bc-add1-9487e3c2d752 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:07.012100 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1619d63d-66b8-47bc-add1-9487e3c2d752 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:07.018559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1619d63d-66b8-47bc-add1-9487e3c2d752 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.019053 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1619d63d-66b8-47bc-add1-9487e3c2d752 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.019493 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1619d63d-66b8-47bc-add1-9487e3c2d752 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:07.020204 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1619d63d-66b8-47bc-add1-9487e3c2d752 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.020690 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1619d63d-66b8-47bc-add1-9487e3c2d752 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.021700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1619d63d-66b8-47bc-add1-9487e3c2d752 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:07.039487 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:07.095005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:07.095748 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:07.103612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.107578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.107578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:07.107578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.107578 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.108270 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:07.211433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1619d63d-66b8-47bc-add1-9487e3c2d752 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:07.220033 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1619d63d-66b8-47bc-add1-9487e3c2d752 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.213114 Aug 24 05:51:07.220655 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 331/664] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:07 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:07.278089 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:07.287544 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:07.289310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:07.291474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c6e63ba0-8cc1-4ccc-84b8-3d2df98a51e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.200382 Aug 24 05:51:07.292045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 334/665] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:07 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:07.637384 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-fd2da921-ad40-4ff1-9d8c-3e7217259c37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:07.637998 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-fd2da921-ad40-4ff1-9d8c-3e7217259c37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:07.644910 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fd2da921-ad40-4ff1-9d8c-3e7217259c37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.645474 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fd2da921-ad40-4ff1-9d8c-3e7217259c37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.646476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fd2da921-ad40-4ff1-9d8c-3e7217259c37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:07.647443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fd2da921-ad40-4ff1-9d8c-3e7217259c37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.647915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fd2da921-ad40-4ff1-9d8c-3e7217259c37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.648431 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fd2da921-ad40-4ff1-9d8c-3e7217259c37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:07.786979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fd2da921-ad40-4ff1-9d8c-3e7217259c37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:07.795836 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-fd2da921-ad40-4ff1-9d8c-3e7217259c37 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.162111 Aug 24 05:51:07.796630 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 332/666] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:07 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:08.243552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-38985755-40ea-4337-8c26-b6b1c791b084 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:08.244132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-38985755-40ea-4337-8c26-b6b1c791b084 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:08.251151 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38985755-40ea-4337-8c26-b6b1c791b084 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:08.251645 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38985755-40ea-4337-8c26-b6b1c791b084 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:08.252082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38985755-40ea-4337-8c26-b6b1c791b084 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:08.252829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38985755-40ea-4337-8c26-b6b1c791b084 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:08.253279 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38985755-40ea-4337-8c26-b6b1c791b084 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:08.253718 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-38985755-40ea-4337-8c26-b6b1c791b084 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:08.318250 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:08.318963 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:08.325916 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:08.326383 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:08.326851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:08.327552 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:08.327998 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:08.328438 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:08.496484 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-38985755-40ea-4337-8c26-b6b1c791b084 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:08.513464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-38985755-40ea-4337-8c26-b6b1c791b084 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.274323 Aug 24 05:51:08.523968 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 335/667] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:08 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:08.532850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:08.543363 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:08.552993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:08.552993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-41bfb53b-4ce4-42a8-9920-b2323d3ff8b0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.235981 Aug 24 05:51:08.552993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 333/668] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:08 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:08.816703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-30c76688-f191-454e-b412-a13efd33453c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:08.817061 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-30c76688-f191-454e-b412-a13efd33453c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:08.823486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30c76688-f191-454e-b412-a13efd33453c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:08.824020 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30c76688-f191-454e-b412-a13efd33453c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:08.824429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30c76688-f191-454e-b412-a13efd33453c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:08.825172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30c76688-f191-454e-b412-a13efd33453c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:08.825628 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30c76688-f191-454e-b412-a13efd33453c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:08.826047 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30c76688-f191-454e-b412-a13efd33453c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:08.976201 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-30c76688-f191-454e-b412-a13efd33453c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:08.984884 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-30c76688-f191-454e-b412-a13efd33453c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.172310 Aug 24 05:51:08.985769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 336/669] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:08 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:09.535528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7f92cbdd-86d5-4907-8aa9-8f350c6c4dd7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:09.536111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7f92cbdd-86d5-4907-8aa9-8f350c6c4dd7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:09.542921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7f92cbdd-86d5-4907-8aa9-8f350c6c4dd7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:09.543402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7f92cbdd-86d5-4907-8aa9-8f350c6c4dd7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:09.543841 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7f92cbdd-86d5-4907-8aa9-8f350c6c4dd7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:09.544573 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7f92cbdd-86d5-4907-8aa9-8f350c6c4dd7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:09.545038 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7f92cbdd-86d5-4907-8aa9-8f350c6c4dd7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:09.545730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7f92cbdd-86d5-4907-8aa9-8f350c6c4dd7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:09.580341 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:09.581078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:09.589616 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:09.590117 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:09.590553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:09.591425 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:09.592204 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:09.592694 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:09.763120 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7f92cbdd-86d5-4907-8aa9-8f350c6c4dd7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:09.777786 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7f92cbdd-86d5-4907-8aa9-8f350c6c4dd7 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.246043 Aug 24 05:51:09.778725 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 334/670] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:09 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:09.790347 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:09.799310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:09.800849 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:09.801983 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-cbf6a136-1bbb-4b0a-b89a-97c49739f9ee tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.225578 Aug 24 05:51:09.803210 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 337/671] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:09 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:10.006753 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e28e1733-4f57-4606-896a-36b1991aad82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:10.007356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e28e1733-4f57-4606-896a-36b1991aad82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:10.014032 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e28e1733-4f57-4606-896a-36b1991aad82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:10.014521 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e28e1733-4f57-4606-896a-36b1991aad82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:10.014976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e28e1733-4f57-4606-896a-36b1991aad82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:10.015673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e28e1733-4f57-4606-896a-36b1991aad82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:10.016127 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e28e1733-4f57-4606-896a-36b1991aad82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:10.016576 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e28e1733-4f57-4606-896a-36b1991aad82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:10.159473 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e28e1733-4f57-4606-896a-36b1991aad82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:10.168876 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e28e1733-4f57-4606-896a-36b1991aad82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.166062 Aug 24 05:51:10.169543 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 335/672] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:10 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:10.799275 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e3627bd6-33f5-433a-9d05-126aabe2b81b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:10.799884 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e3627bd6-33f5-433a-9d05-126aabe2b81b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:10.807144 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e3627bd6-33f5-433a-9d05-126aabe2b81b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:10.807627 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e3627bd6-33f5-433a-9d05-126aabe2b81b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:10.808059 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e3627bd6-33f5-433a-9d05-126aabe2b81b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:10.808783 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e3627bd6-33f5-433a-9d05-126aabe2b81b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:10.809232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e3627bd6-33f5-433a-9d05-126aabe2b81b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:10.809653 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e3627bd6-33f5-433a-9d05-126aabe2b81b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:10.828832 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:10.829429 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:10.836866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:10.837488 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:10.837799 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:10.838504 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:10.838962 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:10.839435 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:11.028241 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e3627bd6-33f5-433a-9d05-126aabe2b81b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:11.040174 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e3627bd6-33f5-433a-9d05-126aabe2b81b tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.244920 Aug 24 05:51:11.040789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 338/673] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:10 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:11.058754 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:11.069422 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:11.070975 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:11.072277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-68fe2e69-5ca0-421b-b48b-3a0b8a765dd2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.248868 Aug 24 05:51:11.072884 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 336/674] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:10 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:11.191253 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e862988f-1c1d-43e8-a48e-e9678a42da97 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:11.191863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e862988f-1c1d-43e8-a48e-e9678a42da97 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:11.198082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e862988f-1c1d-43e8-a48e-e9678a42da97 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:11.198567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e862988f-1c1d-43e8-a48e-e9678a42da97 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:11.198997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e862988f-1c1d-43e8-a48e-e9678a42da97 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:11.199690 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e862988f-1c1d-43e8-a48e-e9678a42da97 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:11.200140 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e862988f-1c1d-43e8-a48e-e9678a42da97 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:11.200600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e862988f-1c1d-43e8-a48e-e9678a42da97 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:11.344535 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e862988f-1c1d-43e8-a48e-e9678a42da97 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:11.355569 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e862988f-1c1d-43e8-a48e-e9678a42da97 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.168161 Aug 24 05:51:11.368858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 339/675] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:11 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:12.064445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7d944082-89f9-40fc-b0ec-96e10ab4a328 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:12.066269 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7d944082-89f9-40fc-b0ec-96e10ab4a328 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:12.074105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7d944082-89f9-40fc-b0ec-96e10ab4a328 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:12.074694 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7d944082-89f9-40fc-b0ec-96e10ab4a328 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:12.075213 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7d944082-89f9-40fc-b0ec-96e10ab4a328 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:12.076320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7d944082-89f9-40fc-b0ec-96e10ab4a328 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:12.076871 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7d944082-89f9-40fc-b0ec-96e10ab4a328 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:12.077499 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7d944082-89f9-40fc-b0ec-96e10ab4a328 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:12.095114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:12.095832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:12.103703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:12.104232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:12.104696 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:12.105400 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:12.105862 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:12.106392 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:12.310424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:12.315750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7d944082-89f9-40fc-b0ec-96e10ab4a328 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:12.320416 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:12.321974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:12.323132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e9945f3c-7bfb-44ee-892d-9c10b65ac12c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.231963 Aug 24 05:51:12.323688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 340/676] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:12 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:12.324641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7d944082-89f9-40fc-b0ec-96e10ab4a328 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.266067 Aug 24 05:51:12.325126 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 337/677] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:12 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:12.378734 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1dd82473-2bb4-4eca-9f45-22113ffd1439 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:12.379392 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1dd82473-2bb4-4eca-9f45-22113ffd1439 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:12.386010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1dd82473-2bb4-4eca-9f45-22113ffd1439 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:12.386527 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1dd82473-2bb4-4eca-9f45-22113ffd1439 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:12.387090 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1dd82473-2bb4-4eca-9f45-22113ffd1439 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:12.387874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1dd82473-2bb4-4eca-9f45-22113ffd1439 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:12.388535 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1dd82473-2bb4-4eca-9f45-22113ffd1439 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:12.388946 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1dd82473-2bb4-4eca-9f45-22113ffd1439 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:12.531395 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1dd82473-2bb4-4eca-9f45-22113ffd1439 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:12.539886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1dd82473-2bb4-4eca-9f45-22113ffd1439 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.164939 Aug 24 05:51:12.540477 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 341/678] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:12 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:13.346338 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8f72a698-2d77-4cdc-81cb-87c9b34807a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:13.346965 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8f72a698-2d77-4cdc-81cb-87c9b34807a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:13.347319 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:13.347929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:13.354204 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f72a698-2d77-4cdc-81cb-87c9b34807a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:13.354690 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f72a698-2d77-4cdc-81cb-87c9b34807a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:13.355228 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f72a698-2d77-4cdc-81cb-87c9b34807a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:13.355617 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:13.355921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f72a698-2d77-4cdc-81cb-87c9b34807a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:13.356108 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:13.356289 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f72a698-2d77-4cdc-81cb-87c9b34807a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:13.356587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:13.356745 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f72a698-2d77-4cdc-81cb-87c9b34807a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:13.357284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:13.357741 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:13.358167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:13.544758 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:13.554328 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:13.555968 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:13.557241 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-382ed5a8-f2d8-46d8-bb5a-9a4f569e0305 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.213747 Aug 24 05:51:13.557801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 342/679] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:13 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:13.562333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3367b135-a2b9-42b9-8d99-7efe53f10a5b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:13.562945 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3367b135-a2b9-42b9-8d99-7efe53f10a5b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:13.564695 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8f72a698-2d77-4cdc-81cb-87c9b34807a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:13.568875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3367b135-a2b9-42b9-8d99-7efe53f10a5b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:13.570000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3367b135-a2b9-42b9-8d99-7efe53f10a5b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:13.570447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3367b135-a2b9-42b9-8d99-7efe53f10a5b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:13.571143 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3367b135-a2b9-42b9-8d99-7efe53f10a5b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:13.571603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3367b135-a2b9-42b9-8d99-7efe53f10a5b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:13.572028 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3367b135-a2b9-42b9-8d99-7efe53f10a5b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:13.573455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8f72a698-2d77-4cdc-81cb-87c9b34807a6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.231014 Aug 24 05:51:13.574021 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 338/680] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:13 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:13.587929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:13.703151 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3367b135-a2b9-42b9-8d99-7efe53f10a5b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:13.712283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3367b135-a2b9-42b9-8d99-7efe53f10a5b tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.153450 Aug 24 05:51:13.712812 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 343/681] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:13 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:14.580092 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:14.580710 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:14.587197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:14.587698 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:14.588114 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:14.588837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:14.589291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:14.589719 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:14.595006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-81a5dd5f-ae74-4241-bf29-13ce271d2168 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:14.595704 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-81a5dd5f-ae74-4241-bf29-13ce271d2168 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:14.603088 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-81a5dd5f-ae74-4241-bf29-13ce271d2168 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:14.603676 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-81a5dd5f-ae74-4241-bf29-13ce271d2168 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:14.604154 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-81a5dd5f-ae74-4241-bf29-13ce271d2168 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:14.604971 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-81a5dd5f-ae74-4241-bf29-13ce271d2168 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:14.605778 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-81a5dd5f-ae74-4241-bf29-13ce271d2168 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:14.606518 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-81a5dd5f-ae74-4241-bf29-13ce271d2168 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:14.797263 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:14.807083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:14.808680 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:14.809827 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-cb646b83-344a-4383-b81e-8e6a36167c57 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.233743 Aug 24 05:51:14.810389 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 339/682] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:14 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:14.814877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0941d820-984c-494a-93ea-416e38b4e1d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:14.815441 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-81a5dd5f-ae74-4241-bf29-13ce271d2168 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:14.815612 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0941d820-984c-494a-93ea-416e38b4e1d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:14.822201 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0941d820-984c-494a-93ea-416e38b4e1d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:14.822702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0941d820-984c-494a-93ea-416e38b4e1d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:14.823244 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0941d820-984c-494a-93ea-416e38b4e1d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:14.823910 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0941d820-984c-494a-93ea-416e38b4e1d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:14.824040 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-81a5dd5f-ae74-4241-bf29-13ce271d2168 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.232827 Aug 24 05:51:14.824375 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0941d820-984c-494a-93ea-416e38b4e1d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:14.824591 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 344/683] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:14 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:14.824885 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0941d820-984c-494a-93ea-416e38b4e1d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:14.954167 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0941d820-984c-494a-93ea-416e38b4e1d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:14.963284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0941d820-984c-494a-93ea-416e38b4e1d4 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.151929 Aug 24 05:51:14.963852 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 340/684] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:14 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:15.834002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:15.835638 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:15.842050 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:15.842536 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:15.842977 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:15.843692 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:15.844134 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:15.844595 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:15.845694 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3da60802-5cec-47ea-969b-e565de6656b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:15.846328 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3da60802-5cec-47ea-969b-e565de6656b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:15.853557 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3da60802-5cec-47ea-969b-e565de6656b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:15.854036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3da60802-5cec-47ea-969b-e565de6656b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:15.854471 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3da60802-5cec-47ea-969b-e565de6656b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:15.855158 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3da60802-5cec-47ea-969b-e565de6656b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:15.855608 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3da60802-5cec-47ea-969b-e565de6656b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:15.856026 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3da60802-5cec-47ea-969b-e565de6656b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:16.045746 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:16.055030 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:16.056622 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:16.057827 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c4ec6791-c33d-45f5-82b8-1cbe25903cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.227778 Aug 24 05:51:16.058390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 345/685] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:15 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:16.060138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3da60802-5cec-47ea-969b-e565de6656b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:16.063097 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1b5f78a7-b0aa-4e66-b8a7-0f2d9f985b88 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:16.063714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1b5f78a7-b0aa-4e66-b8a7-0f2d9f985b88 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:16.069523 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3da60802-5cec-47ea-969b-e565de6656b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.226925 Aug 24 05:51:16.070300 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 341/686] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:15 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:16.070431 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b5f78a7-b0aa-4e66-b8a7-0f2d9f985b88 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:16.070731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b5f78a7-b0aa-4e66-b8a7-0f2d9f985b88 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:16.071237 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b5f78a7-b0aa-4e66-b8a7-0f2d9f985b88 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:16.071935 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b5f78a7-b0aa-4e66-b8a7-0f2d9f985b88 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:16.072410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b5f78a7-b0aa-4e66-b8a7-0f2d9f985b88 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:16.072875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b5f78a7-b0aa-4e66-b8a7-0f2d9f985b88 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:16.205162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1b5f78a7-b0aa-4e66-b8a7-0f2d9f985b88 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:16.214524 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1b5f78a7-b0aa-4e66-b8a7-0f2d9f985b88 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.154979 Aug 24 05:51:16.215011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 346/687] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:16 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:17.080520 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:17.081123 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:17.088106 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:17.088629 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:17.089100 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:17.089801 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:17.090255 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:17.090680 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:17.091773 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-818959ea-900b-4aae-ac2f-d3aeab35773e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:17.092406 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-818959ea-900b-4aae-ac2f-d3aeab35773e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:17.098890 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-818959ea-900b-4aae-ac2f-d3aeab35773e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:17.099379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-818959ea-900b-4aae-ac2f-d3aeab35773e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:17.099853 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-818959ea-900b-4aae-ac2f-d3aeab35773e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:17.101488 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-818959ea-900b-4aae-ac2f-d3aeab35773e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:17.101961 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-818959ea-900b-4aae-ac2f-d3aeab35773e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:17.102395 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-818959ea-900b-4aae-ac2f-d3aeab35773e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:17.289717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:17.298665 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:17.300179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:17.301374 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e7d81ab4-37b6-4317-bf0c-672c1bbb5ecf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.224805 Aug 24 05:51:17.301930 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 342/688] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:17 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:17.304837 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-818959ea-900b-4aae-ac2f-d3aeab35773e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:17.306566 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1cde4cd4-1428-4448-87ec-8df6341580e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:17.307174 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1cde4cd4-1428-4448-87ec-8df6341580e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:17.312987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cde4cd4-1428-4448-87ec-8df6341580e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:17.313474 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cde4cd4-1428-4448-87ec-8df6341580e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:17.313740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-818959ea-900b-4aae-ac2f-d3aeab35773e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.225739 Aug 24 05:51:17.313971 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cde4cd4-1428-4448-87ec-8df6341580e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:17.314530 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 347/689] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:17 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:17.314642 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cde4cd4-1428-4448-87ec-8df6341580e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:17.315037 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cde4cd4-1428-4448-87ec-8df6341580e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:17.315478 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cde4cd4-1428-4448-87ec-8df6341580e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:17.447344 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1cde4cd4-1428-4448-87ec-8df6341580e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:17.455483 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1cde4cd4-1428-4448-87ec-8df6341580e3 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.152599 Aug 24 05:51:17.456057 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 343/690] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:17 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:18.324518 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:18.325117 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:18.331553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:18.332059 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:18.332517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:18.333205 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:18.333656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:18.334078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:18.335352 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9104c0ec-d6c7-4270-b077-ef10f99ffad1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:18.335999 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9104c0ec-d6c7-4270-b077-ef10f99ffad1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:18.342570 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9104c0ec-d6c7-4270-b077-ef10f99ffad1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:18.343058 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9104c0ec-d6c7-4270-b077-ef10f99ffad1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:18.343501 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9104c0ec-d6c7-4270-b077-ef10f99ffad1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:18.344198 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9104c0ec-d6c7-4270-b077-ef10f99ffad1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:18.344682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9104c0ec-d6c7-4270-b077-ef10f99ffad1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:18.345115 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9104c0ec-d6c7-4270-b077-ef10f99ffad1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:18.807191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:18.816960 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:18.818492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:18.819850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-738b7301-5e1e-4b5f-b8e4-f6461a92c4dc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.499300 Aug 24 05:51:18.820425 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 348/691] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:18 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:18.824924 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7b1a53f3-c791-47d3-9eb6-a797ff51691e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:18.825522 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7b1a53f3-c791-47d3-9eb6-a797ff51691e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:18.831353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7b1a53f3-c791-47d3-9eb6-a797ff51691e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:18.831835 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7b1a53f3-c791-47d3-9eb6-a797ff51691e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:18.832269 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7b1a53f3-c791-47d3-9eb6-a797ff51691e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:18.833016 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7b1a53f3-c791-47d3-9eb6-a797ff51691e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:18.833520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7b1a53f3-c791-47d3-9eb6-a797ff51691e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:18.833863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7b1a53f3-c791-47d3-9eb6-a797ff51691e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:18.836096 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9104c0ec-d6c7-4270-b077-ef10f99ffad1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:18.844375 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9104c0ec-d6c7-4270-b077-ef10f99ffad1 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1749 microversion: 2.1 time: 0.512950 Aug 24 05:51:18.845025 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 344/692] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:18 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1749 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:19.044854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7b1a53f3-c791-47d3-9eb6-a797ff51691e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:19.054851 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7b1a53f3-c791-47d3-9eb6-a797ff51691e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.233294 Aug 24 05:51:19.055527 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 349/693] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:18 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:19.846320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:19.846968 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:19.853455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:19.853944 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:19.854385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:19.855078 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:19.855536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:19.855963 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:19.866081 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bf5b2980-fd10-4236-bd71-a9bd042fbff6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:19.866691 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bf5b2980-fd10-4236-bd71-a9bd042fbff6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:19.873190 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf5b2980-fd10-4236-bd71-a9bd042fbff6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:19.873675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf5b2980-fd10-4236-bd71-a9bd042fbff6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:19.874113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf5b2980-fd10-4236-bd71-a9bd042fbff6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:19.874806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf5b2980-fd10-4236-bd71-a9bd042fbff6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:19.875267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf5b2980-fd10-4236-bd71-a9bd042fbff6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:19.875690 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf5b2980-fd10-4236-bd71-a9bd042fbff6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:20.064141 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:20.073710 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:20.075225 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:20.076414 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-bc529def-ce0d-4bb7-87f3-6e4cbe2d89bc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.234063 Aug 24 05:51:20.076984 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 345/694] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:19 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:20.081519 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c51bf47e-b8ab-4004-be4f-636131dc395c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:20.082157 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c51bf47e-b8ab-4004-be4f-636131dc395c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:20.084762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bf5b2980-fd10-4236-bd71-a9bd042fbff6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:20.088759 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c51bf47e-b8ab-4004-be4f-636131dc395c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:20.089187 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c51bf47e-b8ab-4004-be4f-636131dc395c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:20.089634 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c51bf47e-b8ab-4004-be4f-636131dc395c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:20.090348 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c51bf47e-b8ab-4004-be4f-636131dc395c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:20.090808 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c51bf47e-b8ab-4004-be4f-636131dc395c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:20.091242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c51bf47e-b8ab-4004-be4f-636131dc395c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:20.094194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bf5b2980-fd10-4236-bd71-a9bd042fbff6 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.231934 Aug 24 05:51:20.094803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 350/695] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:19 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:20.225644 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c51bf47e-b8ab-4004-be4f-636131dc395c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:20.233975 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c51bf47e-b8ab-4004-be4f-636131dc395c tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.156048 Aug 24 05:51:20.238599 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 346/696] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:20 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:21.099593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:21.101424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:21.107975 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:21.108493 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:21.108940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:21.110253 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:21.110253 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:21.110583 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:21.115970 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2c45ddeb-1cd0-4e20-b30f-ee4e4ea21b9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:21.116712 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2c45ddeb-1cd0-4e20-b30f-ee4e4ea21b9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:21.123641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c45ddeb-1cd0-4e20-b30f-ee4e4ea21b9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:21.124095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c45ddeb-1cd0-4e20-b30f-ee4e4ea21b9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:21.124560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c45ddeb-1cd0-4e20-b30f-ee4e4ea21b9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:21.125256 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c45ddeb-1cd0-4e20-b30f-ee4e4ea21b9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:21.125717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c45ddeb-1cd0-4e20-b30f-ee4e4ea21b9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:21.126146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c45ddeb-1cd0-4e20-b30f-ee4e4ea21b9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:21.298980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:21.310428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:21.310829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:21.312015 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-26a86b7c-d344-4f0d-a6c6-01e6aedc70bd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.216433 Aug 24 05:51:21.325141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 351/697] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:21 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:21.333872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-01736338-cb38-4dcc-9bfd-17382d8552cb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:21.335334 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-01736338-cb38-4dcc-9bfd-17382d8552cb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:21.340176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2c45ddeb-1cd0-4e20-b30f-ee4e4ea21b9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:21.341730 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-01736338-cb38-4dcc-9bfd-17382d8552cb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:21.342225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-01736338-cb38-4dcc-9bfd-17382d8552cb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:21.342665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-01736338-cb38-4dcc-9bfd-17382d8552cb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:21.343368 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-01736338-cb38-4dcc-9bfd-17382d8552cb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:21.343828 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-01736338-cb38-4dcc-9bfd-17382d8552cb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:21.344321 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-01736338-cb38-4dcc-9bfd-17382d8552cb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:21.352767 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2c45ddeb-1cd0-4e20-b30f-ee4e4ea21b9f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.240606 Aug 24 05:51:21.353545 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 347/698] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:21 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:21.488124 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-01736338-cb38-4dcc-9bfd-17382d8552cb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:21.497923 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-01736338-cb38-4dcc-9bfd-17382d8552cb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.171615 Aug 24 05:51:21.498490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 352/699] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:21 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:22.339965 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:22.340706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:22.347191 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.347672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.348102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.348818 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.349272 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.350384 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.353058 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:22.374048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8f6874ec-04f2-45cf-9ca5-ef0100ee5030 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:22.374646 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8f6874ec-04f2-45cf-9ca5-ef0100ee5030 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:22.380772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f6874ec-04f2-45cf-9ca5-ef0100ee5030 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.381251 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f6874ec-04f2-45cf-9ca5-ef0100ee5030 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.381832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f6874ec-04f2-45cf-9ca5-ef0100ee5030 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.382354 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f6874ec-04f2-45cf-9ca5-ef0100ee5030 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.382800 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f6874ec-04f2-45cf-9ca5-ef0100ee5030 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.383224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f6874ec-04f2-45cf-9ca5-ef0100ee5030 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.551403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:22.561534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:22.563039 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:22.564702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-34f7a056-62fc-47fb-81dc-15328ca65d22 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.228247 Aug 24 05:51:22.565653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 348/700] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:22 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:22.574188 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-99a2e65e-ff11-4626-aae3-6c10536d58df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:22.575322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-99a2e65e-ff11-4626-aae3-6c10536d58df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:22.584706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-99a2e65e-ff11-4626-aae3-6c10536d58df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.584706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-99a2e65e-ff11-4626-aae3-6c10536d58df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.585102 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8f6874ec-04f2-45cf-9ca5-ef0100ee5030 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:22.585212 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-99a2e65e-ff11-4626-aae3-6c10536d58df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.585212 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-99a2e65e-ff11-4626-aae3-6c10536d58df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.585212 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-99a2e65e-ff11-4626-aae3-6c10536d58df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.585755 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-99a2e65e-ff11-4626-aae3-6c10536d58df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.593158 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8f6874ec-04f2-45cf-9ca5-ef0100ee5030 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.222826 Aug 24 05:51:22.593737 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 353/701] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:22 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:22.717802 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-99a2e65e-ff11-4626-aae3-6c10536d58df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:22.726033 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-99a2e65e-ff11-4626-aae3-6c10536d58df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.158969 Aug 24 05:51:22.726598 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 349/702] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:22 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:23.589640 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:23.590238 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:23.592545 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=74 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:23.597255 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:23.597727 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:23.598166 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:23.598843 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:23.599289 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:23.600233 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:23.616189 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9d3c5921-4a86-4a0e-a81f-e1de74bf489e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:23.617156 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9d3c5921-4a86-4a0e-a81f-e1de74bf489e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:23.623702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d3c5921-4a86-4a0e-a81f-e1de74bf489e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:23.624730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d3c5921-4a86-4a0e-a81f-e1de74bf489e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:23.624730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d3c5921-4a86-4a0e-a81f-e1de74bf489e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:23.625353 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d3c5921-4a86-4a0e-a81f-e1de74bf489e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:23.625810 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d3c5921-4a86-4a0e-a81f-e1de74bf489e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:23.626243 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9d3c5921-4a86-4a0e-a81f-e1de74bf489e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:23.814812 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:23.824123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:23.825700 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:23.827148 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a00b3580-29d9-4468-95dd-b374b868b1ff tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.241147 Aug 24 05:51:23.827432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 354/703] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:23 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:23.831857 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d0315084-c4c7-48d5-ab2b-5e5256890dd7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:23.832237 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9d3c5921-4a86-4a0e-a81f-e1de74bf489e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:23.832495 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d0315084-c4c7-48d5-ab2b-5e5256890dd7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:23.839603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d0315084-c4c7-48d5-ab2b-5e5256890dd7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:23.840185 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d0315084-c4c7-48d5-ab2b-5e5256890dd7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:23.840675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d0315084-c4c7-48d5-ab2b-5e5256890dd7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:23.841303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d0315084-c4c7-48d5-ab2b-5e5256890dd7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:23.841672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9d3c5921-4a86-4a0e-a81f-e1de74bf489e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.230132 Aug 24 05:51:23.841984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d0315084-c4c7-48d5-ab2b-5e5256890dd7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:23.842242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 350/704] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:23 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:23.842413 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d0315084-c4c7-48d5-ab2b-5e5256890dd7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:23.977782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d0315084-c4c7-48d5-ab2b-5e5256890dd7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:23.985951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d0315084-c4c7-48d5-ab2b-5e5256890dd7 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1734 microversion: 2.1 time: 0.157564 Aug 24 05:51:23.986514 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 355/705] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:23 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:24.850624 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:24.851208 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:24.858017 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:24.858739 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:24.859182 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:24.859932 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:24.860409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:24.860913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:24.863466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8dc2d1c6-7109-46c4-b322-23e2539e5f60 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:24.864113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8dc2d1c6-7109-46c4-b322-23e2539e5f60 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:24.871358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dc2d1c6-7109-46c4-b322-23e2539e5f60 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:24.871831 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dc2d1c6-7109-46c4-b322-23e2539e5f60 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:24.872256 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dc2d1c6-7109-46c4-b322-23e2539e5f60 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:24.872976 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dc2d1c6-7109-46c4-b322-23e2539e5f60 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:24.873418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dc2d1c6-7109-46c4-b322-23e2539e5f60 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:24.873839 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8dc2d1c6-7109-46c4-b322-23e2539e5f60 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.058528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:25.068800 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:25.070343 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:25.071508 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2086569b-cddc-4d1d-a272-4f11823f5e16 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.224984 Aug 24 05:51:25.072080 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 351/706] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:24 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:25.076622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e5b0507c-24ed-4b48-8c9f-25e8feedcd21 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:25.077234 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e5b0507c-24ed-4b48-8c9f-25e8feedcd21 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:25.083231 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5b0507c-24ed-4b48-8c9f-25e8feedcd21 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.083717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5b0507c-24ed-4b48-8c9f-25e8feedcd21 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.084311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5b0507c-24ed-4b48-8c9f-25e8feedcd21 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.085213 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5b0507c-24ed-4b48-8c9f-25e8feedcd21 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.085675 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5b0507c-24ed-4b48-8c9f-25e8feedcd21 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.086115 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5b0507c-24ed-4b48-8c9f-25e8feedcd21 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.089539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8dc2d1c6-7109-46c4-b322-23e2539e5f60 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:25.097826 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8dc2d1c6-7109-46c4-b322-23e2539e5f60 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.238295 Aug 24 05:51:25.098397 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 356/707] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:24 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:25.218617 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e5b0507c-24ed-4b48-8c9f-25e8feedcd21 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:25.227997 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e5b0507c-24ed-4b48-8c9f-25e8feedcd21 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1714 microversion: 2.1 time: 0.154554 Aug 24 05:51:25.228610 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 352/708] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:25 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:25.289581 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:25.290101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:25.296300 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.296814 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.297248 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.297928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.298380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.298801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.425429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] HTTP exception thrown: Cannot 'detach_volume' instance 64eb4995-d137-42b3-96b4-1af57d704189 while it is in vm_state rescued Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Request method failure captured: Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: DELETE /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments/b1c66e97-1bff-4aa8-bd0f-f5e97b527934 HTTP/1.1 Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrJzcprHqQlE5leVvGfV6xgwH1tOW0OIj8bhIII0tPRpVgD4vrhN0TkXcTjl15pHeEFXnr9AQBXPxDdB2BYsR5TOA76YGfCuwpJD9i-Sssl_bP9CSaMttD_juz07C2hdpqvtLcP6hER3DOwih0w66MhihvnUtIVn_DOGnwbrS6REzc Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 39a99050c88d48db851f437f68b65a58 Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:51:25.427056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:51:25.429011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_39a99050c88d48db851f437f68b65a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a99050c88d48db851f437f68b65a58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/39a99050c88d48db851f437f68b65a58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a99050c88d48db851f437f68b65a58"}]}] Aug 24 05:51:25.429011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:51:25.429011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 39a99050c88d48db851f437f68b65a58 Aug 24 05:51:25.429011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:51:25.429011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-ServerRescueNegativeTestJSON-1927483895-project Aug 24 05:51:25.429011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:51:25.429011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:51:25.429011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 926115c2e54741e6a3aca02437309b8f Aug 24 05:51:25.429011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1927483895-project Aug 24 05:51:25.429011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:51:25.429011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Cannot 'detach_volume' instance 64eb4995-d137-42b3-96b4-1af57d704189 while it is in vm_state rescued Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'server_id': '64eb4995-d137-42b3-96b4-1af57d704189', 'id': 'b1c66e97-1bff-4aa8-bd0f-f5e97b527934'} Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64eb4995-d137-42b3-96b4-1af57d704189 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:51:25.429723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 64eb4995-d137-42b3-96b4-1af57d704189 while it is in vm_state rescued Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 64eb4995-d137-42b3-96b4-1af57d704189 while it is in vm_state rescued Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:51:25.431107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Returning 409 to user: Cannot 'detach_volume' instance 64eb4995-d137-42b3-96b4-1af57d704189 while it is in vm_state rescued {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:51:25.432697 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bea6a323-71a8-47d4-bae8-49c0b88d0325 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "DELETE /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments/b1c66e97-1bff-4aa8-bd0f-f5e97b527934" status: 409 len: 152 microversion: 2.1 time: 0.143605 Aug 24 05:51:25.432697 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 357/709] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 05:51:25 2022] DELETE /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments/b1c66e97-1bff-4aa8-bd0f-f5e97b527934 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:51:25.437619 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e01be872-5ea2-4297-91a7-8be41d3047eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:25.438152 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e01be872-5ea2-4297-91a7-8be41d3047eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:25.444272 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e01be872-5ea2-4297-91a7-8be41d3047eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.444794 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e01be872-5ea2-4297-91a7-8be41d3047eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.445238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e01be872-5ea2-4297-91a7-8be41d3047eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.445923 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e01be872-5ea2-4297-91a7-8be41d3047eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.446376 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e01be872-5ea2-4297-91a7-8be41d3047eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.446798 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e01be872-5ea2-4297-91a7-8be41d3047eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.693067 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e01be872-5ea2-4297-91a7-8be41d3047eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "POST /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/action" status: 202 len: 0 microversion: 2.1 time: 0.258987 Aug 24 05:51:25.694200 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 353/710] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:51:25 2022] POST /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:51:25.703146 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-248b6484-45a2-4d6e-8142-89fc4d5be05e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:25.709042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-248b6484-45a2-4d6e-8142-89fc4d5be05e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:25.712481 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-248b6484-45a2-4d6e-8142-89fc4d5be05e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.712985 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-248b6484-45a2-4d6e-8142-89fc4d5be05e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.713422 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-248b6484-45a2-4d6e-8142-89fc4d5be05e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.714129 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-248b6484-45a2-4d6e-8142-89fc4d5be05e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.714587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-248b6484-45a2-4d6e-8142-89fc4d5be05e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.715016 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-248b6484-45a2-4d6e-8142-89fc4d5be05e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.854459 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-248b6484-45a2-4d6e-8142-89fc4d5be05e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:25.862636 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-248b6484-45a2-4d6e-8142-89fc4d5be05e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1722 microversion: 2.1 time: 0.163800 Aug 24 05:51:25.863195 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 358/711] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:25 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:26.119714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-28b573b4-3107-477e-9fd7-c78c80b54621 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:26.120429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-28b573b4-3107-477e-9fd7-c78c80b54621 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:26.126558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28b573b4-3107-477e-9fd7-c78c80b54621 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.127050 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28b573b4-3107-477e-9fd7-c78c80b54621 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.127489 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28b573b4-3107-477e-9fd7-c78c80b54621 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.128191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28b573b4-3107-477e-9fd7-c78c80b54621 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.128673 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28b573b4-3107-477e-9fd7-c78c80b54621 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.129099 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28b573b4-3107-477e-9fd7-c78c80b54621 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.205140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:26.205928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:26.207928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=72 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:26.213051 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.213555 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.213990 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.214678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.215129 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.215552 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.301605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-28b573b4-3107-477e-9fd7-c78c80b54621 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:26.310681 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-28b573b4-3107-477e-9fd7-c78c80b54621 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.195477 Aug 24 05:51:26.311252 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 359/712] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:26 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:26.367553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:26.376608 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:26.378129 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:26.379298 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4c8ad6f4-4f9e-415c-a972-78a2fa81afd0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.287658 Aug 24 05:51:26.379850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 354/713] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:26 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:26.883829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9eedfacd-0d32-4c75-97a9-c33681a92902 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:26.884494 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9eedfacd-0d32-4c75-97a9-c33681a92902 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:26.890510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eedfacd-0d32-4c75-97a9-c33681a92902 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.890999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eedfacd-0d32-4c75-97a9-c33681a92902 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.891428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eedfacd-0d32-4c75-97a9-c33681a92902 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.892132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eedfacd-0d32-4c75-97a9-c33681a92902 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.892967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eedfacd-0d32-4c75-97a9-c33681a92902 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.893610 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eedfacd-0d32-4c75-97a9-c33681a92902 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.896371 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:27.118821 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9eedfacd-0d32-4c75-97a9-c33681a92902 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:27.127802 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9eedfacd-0d32-4c75-97a9-c33681a92902 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1722 microversion: 2.1 time: 0.248457 Aug 24 05:51:27.128461 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 360/714] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:26 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:27.331424 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-429053ff-a91c-40b5-a6a3-7df863281580 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:27.332064 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-429053ff-a91c-40b5-a6a3-7df863281580 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:27.339028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-429053ff-a91c-40b5-a6a3-7df863281580 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:27.339505 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-429053ff-a91c-40b5-a6a3-7df863281580 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:27.339937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-429053ff-a91c-40b5-a6a3-7df863281580 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:27.340646 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-429053ff-a91c-40b5-a6a3-7df863281580 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:27.341096 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-429053ff-a91c-40b5-a6a3-7df863281580 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:27.341516 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-429053ff-a91c-40b5-a6a3-7df863281580 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:27.403887 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:27.404667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:27.411021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:27.411585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:27.412077 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:27.412953 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:27.413402 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:27.413821 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:27.532266 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-429053ff-a91c-40b5-a6a3-7df863281580 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:27.541642 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-429053ff-a91c-40b5-a6a3-7df863281580 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.214039 Aug 24 05:51:27.550380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 355/715] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:27 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:27.591279 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:27.600074 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:27.601706 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:27.603095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9535dc2d-46d4-43ab-90f5-f65ea6d2b6bf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.203240 Aug 24 05:51:27.603841 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 361/716] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:27 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:28.148920 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-68c606ac-08c9-4ecf-ad60-ab4de72268b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:28.149526 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-68c606ac-08c9-4ecf-ad60-ab4de72268b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:28.155523 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68c606ac-08c9-4ecf-ad60-ab4de72268b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:28.155999 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68c606ac-08c9-4ecf-ad60-ab4de72268b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:28.156458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68c606ac-08c9-4ecf-ad60-ab4de72268b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:28.157153 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68c606ac-08c9-4ecf-ad60-ab4de72268b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:28.157608 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68c606ac-08c9-4ecf-ad60-ab4de72268b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:28.158036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-68c606ac-08c9-4ecf-ad60-ab4de72268b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:28.286234 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-68c606ac-08c9-4ecf-ad60-ab4de72268b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:28.294926 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-68c606ac-08c9-4ecf-ad60-ab4de72268b5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1722 microversion: 2.1 time: 0.149899 Aug 24 05:51:28.295477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 356/717] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:28 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:28.564470 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a4e6b81d-c792-46de-9ddb-18eee2c989fb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:28.565039 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a4e6b81d-c792-46de-9ddb-18eee2c989fb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:28.571965 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4e6b81d-c792-46de-9ddb-18eee2c989fb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:28.572482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4e6b81d-c792-46de-9ddb-18eee2c989fb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:28.572921 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4e6b81d-c792-46de-9ddb-18eee2c989fb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:28.573612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4e6b81d-c792-46de-9ddb-18eee2c989fb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:28.574059 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4e6b81d-c792-46de-9ddb-18eee2c989fb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:28.574504 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a4e6b81d-c792-46de-9ddb-18eee2c989fb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:28.626824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:28.627397 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:28.634241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:28.634731 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:28.635178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:28.635884 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:28.636552 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:28.636987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:28.779162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a4e6b81d-c792-46de-9ddb-18eee2c989fb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:28.787560 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a4e6b81d-c792-46de-9ddb-18eee2c989fb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.227094 Aug 24 05:51:28.788228 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 362/718] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:28 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:28.816906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:28.826931 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:28.828476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:28.829656 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b1eb811a-f6a6-49d6-94d3-6017917d7730 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.206852 Aug 24 05:51:28.830218 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 357/719] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:28 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:29.197075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-d353d440-e3c6-4a01-9c77-4be1e1a5f6b1 req-c6acfef7-93c3-4b99-9b34-45f1aad7aa40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d92fba-9c39-4b5f-971f-83d972055316", "name": "network-vif-plugged", "status": "completed", "tag": "14ce7c9b-e214-4a48-bcb6-c730bc8b2303"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:29.206747 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-d353d440-e3c6-4a01-9c77-4be1e1a5f6b1 req-c6acfef7-93c3-4b99-9b34-45f1aad7aa40 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:29.207200 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-d353d440-e3c6-4a01-9c77-4be1e1a5f6b1 req-c6acfef7-93c3-4b99-9b34-45f1aad7aa40 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:29.207621 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-d353d440-e3c6-4a01-9c77-4be1e1a5f6b1 req-c6acfef7-93c3-4b99-9b34-45f1aad7aa40 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:29.218569 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-d353d440-e3c6-4a01-9c77-4be1e1a5f6b1 req-c6acfef7-93c3-4b99-9b34-45f1aad7aa40 service nova] Creating event network-vif-plugged:14ce7c9b-e214-4a48-bcb6-c730bc8b2303 for instance 27d92fba-9c39-4b5f-971f-83d972055316 on hv-cinder-85426 Aug 24 05:51:29.223821 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-d353d440-e3c6-4a01-9c77-4be1e1a5f6b1 req-c6acfef7-93c3-4b99-9b34-45f1aad7aa40 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030900 Aug 24 05:51:29.224500 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 363/720] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:29.317549 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-756f02b4-62e2-4c7b-baa9-0ac22f349a95 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:29.318942 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-756f02b4-62e2-4c7b-baa9-0ac22f349a95 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:29.325157 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-756f02b4-62e2-4c7b-baa9-0ac22f349a95 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:29.325650 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-756f02b4-62e2-4c7b-baa9-0ac22f349a95 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:29.326095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-756f02b4-62e2-4c7b-baa9-0ac22f349a95 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:29.326796 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-756f02b4-62e2-4c7b-baa9-0ac22f349a95 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:29.327259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-756f02b4-62e2-4c7b-baa9-0ac22f349a95 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:29.327695 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-756f02b4-62e2-4c7b-baa9-0ac22f349a95 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:29.460554 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-756f02b4-62e2-4c7b-baa9-0ac22f349a95 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:29.469179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-756f02b4-62e2-4c7b-baa9-0ac22f349a95 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1722 microversion: 2.1 time: 0.155558 Aug 24 05:51:29.469741 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 358/721] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:29 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:29.811277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-54408d6d-cc8f-4e95-ba14-f0c8a0103fa5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:29.811984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-54408d6d-cc8f-4e95-ba14-f0c8a0103fa5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:29.818323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54408d6d-cc8f-4e95-ba14-f0c8a0103fa5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:29.819167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54408d6d-cc8f-4e95-ba14-f0c8a0103fa5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:29.819617 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54408d6d-cc8f-4e95-ba14-f0c8a0103fa5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:29.820322 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54408d6d-cc8f-4e95-ba14-f0c8a0103fa5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:29.820832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54408d6d-cc8f-4e95-ba14-f0c8a0103fa5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:29.821264 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-54408d6d-cc8f-4e95-ba14-f0c8a0103fa5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:29.853972 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:29.854562 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:29.861140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:29.861628 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:29.862067 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:29.863094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:29.863376 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:29.863641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:30.026914 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-54408d6d-cc8f-4e95-ba14-f0c8a0103fa5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:30.035305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-54408d6d-cc8f-4e95-ba14-f0c8a0103fa5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.228713 Aug 24 05:51:30.035880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 364/722] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:29 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:30.040655 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:30.049611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:30.051115 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:30.052261 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b7694df6-ff3a-43e1-9b15-f343991e0dec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.202851 Aug 24 05:51:30.053338 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 359/723] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:29 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:30.490924 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-19909ac4-50cf-4e5d-adf0-f3780e24b2d5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:30.491529 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-19909ac4-50cf-4e5d-adf0-f3780e24b2d5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:30.497760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-19909ac4-50cf-4e5d-adf0-f3780e24b2d5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:30.498299 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-19909ac4-50cf-4e5d-adf0-f3780e24b2d5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:30.498734 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-19909ac4-50cf-4e5d-adf0-f3780e24b2d5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:30.499419 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-19909ac4-50cf-4e5d-adf0-f3780e24b2d5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:30.499872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-19909ac4-50cf-4e5d-adf0-f3780e24b2d5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:30.500296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-19909ac4-50cf-4e5d-adf0-f3780e24b2d5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:30.646075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-19909ac4-50cf-4e5d-adf0-f3780e24b2d5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:30.654173 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-19909ac4-50cf-4e5d-adf0-f3780e24b2d5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1722 microversion: 2.1 time: 0.167147 Aug 24 05:51:30.654766 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 365/724] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:30 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:31.058385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-480e0d08-a6e5-44d9-814e-4158b70385c5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:31.059275 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-480e0d08-a6e5-44d9-814e-4158b70385c5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:31.068211 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-480e0d08-a6e5-44d9-814e-4158b70385c5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.070450 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-480e0d08-a6e5-44d9-814e-4158b70385c5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.071611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-480e0d08-a6e5-44d9-814e-4158b70385c5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.072279 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-480e0d08-a6e5-44d9-814e-4158b70385c5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.072849 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-480e0d08-a6e5-44d9-814e-4158b70385c5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.073282 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-480e0d08-a6e5-44d9-814e-4158b70385c5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.075646 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:31.076559 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:31.083344 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.083828 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.084268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.085415 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.085882 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.086317 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.297546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:31.303148 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-480e0d08-a6e5-44d9-814e-4158b70385c5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:31.307032 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:31.308606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:31.309699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-085b3cb3-1e91-4266-9a4a-d600cfe46062 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.238283 Aug 24 05:51:31.310260 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 366/725] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:31 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:31.313447 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-480e0d08-a6e5-44d9-814e-4158b70385c5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.259249 Aug 24 05:51:31.314249 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 360/726] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:31 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:31.675536 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fcd2c85f-a858-4b33-97b7-f70885c7f1c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:31.676147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-fcd2c85f-a858-4b33-97b7-f70885c7f1c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:31.682611 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcd2c85f-a858-4b33-97b7-f70885c7f1c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.683096 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcd2c85f-a858-4b33-97b7-f70885c7f1c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.683539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcd2c85f-a858-4b33-97b7-f70885c7f1c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.684228 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcd2c85f-a858-4b33-97b7-f70885c7f1c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.685055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcd2c85f-a858-4b33-97b7-f70885c7f1c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.685484 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fcd2c85f-a858-4b33-97b7-f70885c7f1c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.820954 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-fcd2c85f-a858-4b33-97b7-f70885c7f1c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:31.829480 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-fcd2c85f-a858-4b33-97b7-f70885c7f1c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1728 microversion: 2.1 time: 0.157937 Aug 24 05:51:31.830049 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 367/727] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:31 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:31.851311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d41a8971-4e3d-4315-8835-8fb18a10df1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:31.851811 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d41a8971-4e3d-4315-8835-8fb18a10df1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:31.857935 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d41a8971-4e3d-4315-8835-8fb18a10df1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.858429 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d41a8971-4e3d-4315-8835-8fb18a10df1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.859060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d41a8971-4e3d-4315-8835-8fb18a10df1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.859764 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d41a8971-4e3d-4315-8835-8fb18a10df1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.860233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d41a8971-4e3d-4315-8835-8fb18a10df1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.860692 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d41a8971-4e3d-4315-8835-8fb18a10df1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.954926 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d41a8971-4e3d-4315-8835-8fb18a10df1d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107674 Aug 24 05:51:31.955944 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 361/728] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 24 05:51:31 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:32.332043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:32.332748 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:32.334296 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a5bb3c22-db61-4387-8208-281722f74c9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:32.335180 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a5bb3c22-db61-4387-8208-281722f74c9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:32.339552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:32.340038 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:32.340500 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:32.341199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:32.341844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:32.341954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5bb3c22-db61-4387-8208-281722f74c9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:32.342284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:32.342601 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5bb3c22-db61-4387-8208-281722f74c9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:32.343044 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5bb3c22-db61-4387-8208-281722f74c9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:32.343737 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5bb3c22-db61-4387-8208-281722f74c9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:32.344194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5bb3c22-db61-4387-8208-281722f74c9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:32.344647 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5bb3c22-db61-4387-8208-281722f74c9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:32.634038 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:32.644885 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:32.647063 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:32.649531 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a209b7a9-080b-442d-9498-25cd303598ec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.320372 Aug 24 05:51:32.649531 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 368/729] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:32 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:32.652730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a5bb3c22-db61-4387-8208-281722f74c9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:32.661295 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a5bb3c22-db61-4387-8208-281722f74c9a tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.331475 Aug 24 05:51:32.662133 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 362/730] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:32 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:33.083151 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-307b91d0-82c4-48d6-a993-cdd59a201e72 req-ce2aab57-d6df-4eee-8fa3-020d8834042e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64eb4995-d137-42b3-96b4-1af57d704189", "tag": "9f61d38a-f834-4c44-ba42-d2df9d160ab5"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:33.093180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-307b91d0-82c4-48d6-a993-cdd59a201e72 req-ce2aab57-d6df-4eee-8fa3-020d8834042e service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:33.094137 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-307b91d0-82c4-48d6-a993-cdd59a201e72 req-ce2aab57-d6df-4eee-8fa3-020d8834042e service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:33.094137 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-307b91d0-82c4-48d6-a993-cdd59a201e72 req-ce2aab57-d6df-4eee-8fa3-020d8834042e service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:33.105481 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-307b91d0-82c4-48d6-a993-cdd59a201e72 req-ce2aab57-d6df-4eee-8fa3-020d8834042e service nova] Creating event network-changed:9f61d38a-f834-4c44-ba42-d2df9d160ab5 for instance 64eb4995-d137-42b3-96b4-1af57d704189 on hv-cinder-85426 Aug 24 05:51:33.110492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-307b91d0-82c4-48d6-a993-cdd59a201e72 req-ce2aab57-d6df-4eee-8fa3-020d8834042e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091599 Aug 24 05:51:33.111090 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 369/731] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:33.674039 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:33.674727 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:33.686437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:33.686437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:33.687505 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:33.688473 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:33.689067 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:33.690010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:33.695781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-15eb4e1d-3b9a-47ad-977d-d7eb0dde365e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:33.741419 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-15eb4e1d-3b9a-47ad-977d-d7eb0dde365e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:33.741419 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15eb4e1d-3b9a-47ad-977d-d7eb0dde365e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:33.741419 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15eb4e1d-3b9a-47ad-977d-d7eb0dde365e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:33.741419 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15eb4e1d-3b9a-47ad-977d-d7eb0dde365e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:33.741878 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15eb4e1d-3b9a-47ad-977d-d7eb0dde365e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:33.741878 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15eb4e1d-3b9a-47ad-977d-d7eb0dde365e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:33.741878 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15eb4e1d-3b9a-47ad-977d-d7eb0dde365e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:34.267731 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:34.284176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:34.285920 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:34.287145 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1fd6689d-8363-4f6b-8af0-7dffdcc4af1d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.619452 Aug 24 05:51:34.287676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 363/732] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:33 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:34.332598 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-15eb4e1d-3b9a-47ad-977d-d7eb0dde365e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:34.343189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-15eb4e1d-3b9a-47ad-977d-d7eb0dde365e tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.660219 Aug 24 05:51:34.343869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 370/733] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:33 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:35.125078 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-e9bbe1ec-5f0e-42c3-8973-3430de079671 req-fe84bb58-f4fc-4a08-acdc-c6279ad55108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64eb4995-d137-42b3-96b4-1af57d704189", "tag": "9f61d38a-f834-4c44-ba42-d2df9d160ab5"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:35.135553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-e9bbe1ec-5f0e-42c3-8973-3430de079671 req-fe84bb58-f4fc-4a08-acdc-c6279ad55108 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:35.136030 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-e9bbe1ec-5f0e-42c3-8973-3430de079671 req-fe84bb58-f4fc-4a08-acdc-c6279ad55108 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:35.136485 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-e9bbe1ec-5f0e-42c3-8973-3430de079671 req-fe84bb58-f4fc-4a08-acdc-c6279ad55108 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:35.139129 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:35.149371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-e9bbe1ec-5f0e-42c3-8973-3430de079671 req-fe84bb58-f4fc-4a08-acdc-c6279ad55108 service nova] Creating event network-changed:9f61d38a-f834-4c44-ba42-d2df9d160ab5 for instance 64eb4995-d137-42b3-96b4-1af57d704189 on hv-cinder-85426 Aug 24 05:51:35.154463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-e9bbe1ec-5f0e-42c3-8973-3430de079671 req-fe84bb58-f4fc-4a08-acdc-c6279ad55108 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033040 Aug 24 05:51:35.155060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 364/734] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:35.312029 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:35.312782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:35.320206 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:35.320867 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:35.321373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:35.322143 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:35.322666 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:35.323096 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:35.370506 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4827c0dc-e010-463a-b47c-7c4bb8e90038 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:35.371317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4827c0dc-e010-463a-b47c-7c4bb8e90038 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:35.378430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4827c0dc-e010-463a-b47c-7c4bb8e90038 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:35.378994 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4827c0dc-e010-463a-b47c-7c4bb8e90038 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:35.379509 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4827c0dc-e010-463a-b47c-7c4bb8e90038 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:35.380281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4827c0dc-e010-463a-b47c-7c4bb8e90038 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:35.381652 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4827c0dc-e010-463a-b47c-7c4bb8e90038 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:35.382694 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4827c0dc-e010-463a-b47c-7c4bb8e90038 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:35.615738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:35.626371 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:35.628081 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:35.629265 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3ed3462f-9ac2-46c0-ad49-6145b35290fb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1807 microversion: 2.20 time: 0.321359 Aug 24 05:51:35.629831 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 371/735] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:35 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1807 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:35.661269 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4827c0dc-e010-463a-b47c-7c4bb8e90038 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:35.670170 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4827c0dc-e010-463a-b47c-7c4bb8e90038 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.304718 Aug 24 05:51:35.670997 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 365/736] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:35 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:36.654149 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:36.654756 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:36.661548 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:36.662922 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:36.663362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:36.664070 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:36.664556 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:36.664982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:36.691183 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f5407af2-635b-4ea8-9060-b39ada6fd131 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:36.691794 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f5407af2-635b-4ea8-9060-b39ada6fd131 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:36.698463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5407af2-635b-4ea8-9060-b39ada6fd131 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:36.698949 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5407af2-635b-4ea8-9060-b39ada6fd131 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:36.699385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5407af2-635b-4ea8-9060-b39ada6fd131 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:36.700075 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5407af2-635b-4ea8-9060-b39ada6fd131 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:36.700637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5407af2-635b-4ea8-9060-b39ada6fd131 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:36.701056 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5407af2-635b-4ea8-9060-b39ada6fd131 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:36.851799 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:36.860829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:36.862350 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:36.863550 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-dc13466c-6753-490d-a7fa-ff28b7316101 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1794 microversion: 2.20 time: 0.213778 Aug 24 05:51:36.864108 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 372/737] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:36 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1794 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:36.891197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f5407af2-635b-4ea8-9060-b39ada6fd131 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:36.900973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f5407af2-635b-4ea8-9060-b39ada6fd131 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.213732 Aug 24 05:51:36.901549 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 366/738] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:36 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:37.923386 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ad2ba074-00a2-4649-8651-9c90c9b3848c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:37.924011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ad2ba074-00a2-4649-8651-9c90c9b3848c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:37.931083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad2ba074-00a2-4649-8651-9c90c9b3848c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:37.931562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad2ba074-00a2-4649-8651-9c90c9b3848c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:37.931993 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad2ba074-00a2-4649-8651-9c90c9b3848c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:37.932773 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad2ba074-00a2-4649-8651-9c90c9b3848c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:37.933224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad2ba074-00a2-4649-8651-9c90c9b3848c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:37.933639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad2ba074-00a2-4649-8651-9c90c9b3848c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:38.078364 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ad2ba074-00a2-4649-8651-9c90c9b3848c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:38.087228 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ad2ba074-00a2-4649-8651-9c90c9b3848c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.167934 Aug 24 05:51:38.087790 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 373/739] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:37 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:39.108650 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b68ff874-6dc4-4884-9698-9234c1976784 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:39.109257 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b68ff874-6dc4-4884-9698-9234c1976784 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:39.116260 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b68ff874-6dc4-4884-9698-9234c1976784 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:39.116786 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b68ff874-6dc4-4884-9698-9234c1976784 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:39.117221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b68ff874-6dc4-4884-9698-9234c1976784 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:39.117915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b68ff874-6dc4-4884-9698-9234c1976784 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:39.118361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b68ff874-6dc4-4884-9698-9234c1976784 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:39.118783 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b68ff874-6dc4-4884-9698-9234c1976784 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:39.269066 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b68ff874-6dc4-4884-9698-9234c1976784 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:39.277525 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b68ff874-6dc4-4884-9698-9234c1976784 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.172766 Aug 24 05:51:39.278084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 367/740] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:39 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:40.299439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a8249747-65a7-4da6-ba4d-952e7a9d7e6f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:40.300037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a8249747-65a7-4da6-ba4d-952e7a9d7e6f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:40.307223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a8249747-65a7-4da6-ba4d-952e7a9d7e6f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:40.307703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a8249747-65a7-4da6-ba4d-952e7a9d7e6f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:40.308130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a8249747-65a7-4da6-ba4d-952e7a9d7e6f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:40.308830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a8249747-65a7-4da6-ba4d-952e7a9d7e6f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:40.309279 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a8249747-65a7-4da6-ba4d-952e7a9d7e6f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:40.309695 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a8249747-65a7-4da6-ba4d-952e7a9d7e6f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:40.452227 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a8249747-65a7-4da6-ba4d-952e7a9d7e6f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:40.461535 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a8249747-65a7-4da6-ba4d-952e7a9d7e6f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.166249 Aug 24 05:51:40.462111 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 374/741] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:40 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:41.463330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-747b391c-0bac-48d4-9787-30e810be6af6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:41.463958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-747b391c-0bac-48d4-9787-30e810be6af6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:41.470507 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-747b391c-0bac-48d4-9787-30e810be6af6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.470998 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-747b391c-0bac-48d4-9787-30e810be6af6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.471439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-747b391c-0bac-48d4-9787-30e810be6af6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.472184 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-747b391c-0bac-48d4-9787-30e810be6af6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.472638 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-747b391c-0bac-48d4-9787-30e810be6af6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.473065 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-747b391c-0bac-48d4-9787-30e810be6af6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.483602 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bfe1dc1a-9cf9-448e-a5ae-37a080957cc8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:41.484220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bfe1dc1a-9cf9-448e-a5ae-37a080957cc8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:41.491283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfe1dc1a-9cf9-448e-a5ae-37a080957cc8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.491775 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfe1dc1a-9cf9-448e-a5ae-37a080957cc8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.492489 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfe1dc1a-9cf9-448e-a5ae-37a080957cc8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.493192 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfe1dc1a-9cf9-448e-a5ae-37a080957cc8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.493652 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfe1dc1a-9cf9-448e-a5ae-37a080957cc8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.494084 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bfe1dc1a-9cf9-448e-a5ae-37a080957cc8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.496857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-747b391c-0bac-48d4-9787-30e810be6af6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6/ips" status: 200 len: 151 microversion: 2.1 time: 0.038147 Aug 24 05:51:41.508863 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 368/742] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 24 05:51:41 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:41.519092 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e96c29e-a64c-4087-9ab1-2b8146b1fb76"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:41.522103 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:41.528631 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.529284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.529720 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.530419 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.530869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.531288 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.612610 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Invalid volume: volume 4e96c29e-a64c-4087-9ab1-2b8146b1fb76 is already attached to instances: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: POST /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6/os-volume_attachments HTTP/1.1 Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 74 Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:51:41.617750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {"volumeAttachment": {"volumeId": "4e96c29e-a64c-4087-9ab1-2b8146b1fb76"}} Aug 24 05:51:41.619181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Invalid volume: volume 4e96c29e-a64c-4087-9ab1-2b8146b1fb76 is already attached to instances: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'server_id': '7fa31986-0501-4c2b-a261-04ff2fc14bc6', 'body': {'volumeAttachment': {'volumeId': '4e96c29e-a64c-4087-9ab1-2b8146b1fb76'}}} Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4e96c29e-a64c-4087-9ab1-2b8146b1fb76 is already attached to instances: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:51:41.619979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4e96c29e-a64c-4087-9ab1-2b8146b1fb76 is already attached to instances: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:41.621748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:41.623299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:41.623299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:51:41.623299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:51:41.623299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4e96c29e-a64c-4087-9ab1-2b8146b1fb76 is already attached to instances: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 Aug 24 05:51:41.623299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:51:41.623299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 400 to user: Invalid volume: volume 4e96c29e-a64c-4087-9ab1-2b8146b1fb76 is already attached to instances: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:51:41.623299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-bfa9a118-5e84-4a86-aad7-924bb8306b35 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101319 Aug 24 05:51:41.623299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 369/743] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 05:51:41 2022] POST /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 05:51:41.626364 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-09b1765e-ed17-46f2-998f-4bd4350cbae2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:41.626868 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-09b1765e-ed17-46f2-998f-4bd4350cbae2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:41.634723 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-09b1765e-ed17-46f2-998f-4bd4350cbae2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.635214 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-09b1765e-ed17-46f2-998f-4bd4350cbae2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.635772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-09b1765e-ed17-46f2-998f-4bd4350cbae2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.636365 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-09b1765e-ed17-46f2-998f-4bd4350cbae2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.636853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-09b1765e-ed17-46f2-998f-4bd4350cbae2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.637285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-09b1765e-ed17-46f2-998f-4bd4350cbae2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.654272 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bfe1dc1a-9cf9-448e-a5ae-37a080957cc8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:41.662605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bfe1dc1a-9cf9-448e-a5ae-37a080957cc8 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.182817 Aug 24 05:51:41.663177 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 375/744] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:41 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:41.664247 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-09b1765e-ed17-46f2-998f-4bd4350cbae2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:51:41.974245 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-09b1765e-ed17-46f2-998f-4bd4350cbae2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 204 len: 0 microversion: 2.1 time: 0.351423 Aug 24 05:51:41.975981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 370/745] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:51:41 2022] DELETE /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:51:41.984347 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-cd1f1355-9bb3-4188-9e14-fed772062e11 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:41.984992 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-cd1f1355-9bb3-4188-9e14-fed772062e11 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:41.992206 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd1f1355-9bb3-4188-9e14-fed772062e11 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.998370 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd1f1355-9bb3-4188-9e14-fed772062e11 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.998370 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd1f1355-9bb3-4188-9e14-fed772062e11 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.998370 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd1f1355-9bb3-4188-9e14-fed772062e11 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.998370 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd1f1355-9bb3-4188-9e14-fed772062e11 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.998724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cd1f1355-9bb3-4188-9e14-fed772062e11 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:42.129132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cd1f1355-9bb3-4188-9e14-fed772062e11 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:42.137611 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-cd1f1355-9bb3-4188-9e14-fed772062e11 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1683 microversion: 2.1 time: 0.157171 Aug 24 05:51:42.138182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 376/746] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:41 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:42.685681 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-471929c0-1582-45a6-b1e2-1dfdd51d1205 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:42.686478 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-471929c0-1582-45a6-b1e2-1dfdd51d1205 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:42.694181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-471929c0-1582-45a6-b1e2-1dfdd51d1205 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:42.694671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-471929c0-1582-45a6-b1e2-1dfdd51d1205 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:42.695113 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-471929c0-1582-45a6-b1e2-1dfdd51d1205 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:42.695818 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-471929c0-1582-45a6-b1e2-1dfdd51d1205 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:42.696281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-471929c0-1582-45a6-b1e2-1dfdd51d1205 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:42.696738 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-471929c0-1582-45a6-b1e2-1dfdd51d1205 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:42.844442 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-471929c0-1582-45a6-b1e2-1dfdd51d1205 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:42.856334 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-471929c0-1582-45a6-b1e2-1dfdd51d1205 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.176042 Aug 24 05:51:42.856946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 371/747] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:42 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:43.158621 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7d0fcb7e-4ef3-4d35-b146-17e5a492fdc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:43.159289 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7d0fcb7e-4ef3-4d35-b146-17e5a492fdc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:43.166194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7d0fcb7e-4ef3-4d35-b146-17e5a492fdc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:43.166681 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7d0fcb7e-4ef3-4d35-b146-17e5a492fdc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:43.167121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7d0fcb7e-4ef3-4d35-b146-17e5a492fdc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:43.167820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7d0fcb7e-4ef3-4d35-b146-17e5a492fdc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:43.168280 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7d0fcb7e-4ef3-4d35-b146-17e5a492fdc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:43.168745 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7d0fcb7e-4ef3-4d35-b146-17e5a492fdc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:43.305857 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7d0fcb7e-4ef3-4d35-b146-17e5a492fdc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:43.313698 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7d0fcb7e-4ef3-4d35-b146-17e5a492fdc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1683 microversion: 2.1 time: 0.159662 Aug 24 05:51:43.314457 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 377/748] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:43 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:43.878561 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ed40063a-bbfc-4852-89c0-350d6abca4b4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:43.879228 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ed40063a-bbfc-4852-89c0-350d6abca4b4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:43.886217 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed40063a-bbfc-4852-89c0-350d6abca4b4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:43.886701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed40063a-bbfc-4852-89c0-350d6abca4b4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:43.887145 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed40063a-bbfc-4852-89c0-350d6abca4b4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:43.887843 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed40063a-bbfc-4852-89c0-350d6abca4b4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:43.888300 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed40063a-bbfc-4852-89c0-350d6abca4b4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:43.888752 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed40063a-bbfc-4852-89c0-350d6abca4b4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:44.031553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ed40063a-bbfc-4852-89c0-350d6abca4b4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:44.040677 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ed40063a-bbfc-4852-89c0-350d6abca4b4 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1754 microversion: 2.1 time: 0.165983 Aug 24 05:51:44.041248 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 372/749] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:43 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:44.337330 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-50b354bc-cede-4d38-9672-883f30868f71 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:44.337943 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-50b354bc-cede-4d38-9672-883f30868f71 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:44.344372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-50b354bc-cede-4d38-9672-883f30868f71 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:44.344891 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-50b354bc-cede-4d38-9672-883f30868f71 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:44.345333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-50b354bc-cede-4d38-9672-883f30868f71 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:44.346031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-50b354bc-cede-4d38-9672-883f30868f71 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:44.346509 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-50b354bc-cede-4d38-9672-883f30868f71 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:44.346918 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-50b354bc-cede-4d38-9672-883f30868f71 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:44.350545 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:44.482746 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-50b354bc-cede-4d38-9672-883f30868f71 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:44.490911 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-50b354bc-cede-4d38-9672-883f30868f71 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1683 microversion: 2.1 time: 0.158147 Aug 24 05:51:44.491484 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 378/750] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:44 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:45.063182 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f684406c-f430-4f85-88c2-f8bf92dfab89 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:45.063823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f684406c-f430-4f85-88c2-f8bf92dfab89 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:45.071300 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f684406c-f430-4f85-88c2-f8bf92dfab89 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:45.071823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f684406c-f430-4f85-88c2-f8bf92dfab89 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:45.072261 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f684406c-f430-4f85-88c2-f8bf92dfab89 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:45.073000 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f684406c-f430-4f85-88c2-f8bf92dfab89 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:45.073455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f684406c-f430-4f85-88c2-f8bf92dfab89 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:45.073885 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f684406c-f430-4f85-88c2-f8bf92dfab89 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:45.227200 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f684406c-f430-4f85-88c2-f8bf92dfab89 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:45.237537 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f684406c-f430-4f85-88c2-f8bf92dfab89 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1757 microversion: 2.1 time: 0.178265 Aug 24 05:51:45.238121 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 373/751] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:45 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:45.512156 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-562906c6-9888-4c32-916c-0abfcf86f938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:45.512790 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-562906c6-9888-4c32-916c-0abfcf86f938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:45.519393 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-562906c6-9888-4c32-916c-0abfcf86f938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:45.519902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-562906c6-9888-4c32-916c-0abfcf86f938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:45.520349 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-562906c6-9888-4c32-916c-0abfcf86f938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:45.522474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-562906c6-9888-4c32-916c-0abfcf86f938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:45.522948 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-562906c6-9888-4c32-916c-0abfcf86f938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:45.523485 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-562906c6-9888-4c32-916c-0abfcf86f938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:45.666851 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-562906c6-9888-4c32-916c-0abfcf86f938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:45.675511 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-562906c6-9888-4c32-916c-0abfcf86f938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1683 microversion: 2.1 time: 0.167226 Aug 24 05:51:45.676698 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 379/752] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:45 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:46.701073 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a5e070cd-eef7-4e84-8ece-2c72a9c61cf5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:46.701894 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a5e070cd-eef7-4e84-8ece-2c72a9c61cf5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:46.709764 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5e070cd-eef7-4e84-8ece-2c72a9c61cf5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:46.710244 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5e070cd-eef7-4e84-8ece-2c72a9c61cf5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:46.710895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5e070cd-eef7-4e84-8ece-2c72a9c61cf5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:46.711877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5e070cd-eef7-4e84-8ece-2c72a9c61cf5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:46.712563 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5e070cd-eef7-4e84-8ece-2c72a9c61cf5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:46.712996 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a5e070cd-eef7-4e84-8ece-2c72a9c61cf5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:46.738106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-d5933c54-d809-40b9-87b5-66ee6ca71694 req-af5b43fc-e249-4a29-a15b-55a163920a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa31986-0501-4c2b-a261-04ff2fc14bc6", "name": "network-vif-deleted", "tag": "fec74210-d3e0-46a6-b579-1212f8c1053f"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:46.749623 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-d5933c54-d809-40b9-87b5-66ee6ca71694 req-af5b43fc-e249-4a29-a15b-55a163920a2b service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:46.750134 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-d5933c54-d809-40b9-87b5-66ee6ca71694 req-af5b43fc-e249-4a29-a15b-55a163920a2b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:46.750639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-d5933c54-d809-40b9-87b5-66ee6ca71694 req-af5b43fc-e249-4a29-a15b-55a163920a2b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:46.764568 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-d5933c54-d809-40b9-87b5-66ee6ca71694 req-af5b43fc-e249-4a29-a15b-55a163920a2b service nova] Creating event network-vif-deleted:fec74210-d3e0-46a6-b579-1212f8c1053f for instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 on hv-cinder-85426 Aug 24 05:51:46.770200 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-d5933c54-d809-40b9-87b5-66ee6ca71694 req-af5b43fc-e249-4a29-a15b-55a163920a2b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035983 Aug 24 05:51:46.771972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 380/753] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:51:46.788589 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a5e070cd-eef7-4e84-8ece-2c72a9c61cf5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:46.797968 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a5e070cd-eef7-4e84-8ece-2c72a9c61cf5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1615 microversion: 2.1 time: 0.101092 Aug 24 05:51:46.799161 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 374/754] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:46 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1615 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:47.821125 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:47.821919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:47.830111 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:47.830866 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:47.831488 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:47.832428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:47.833055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:47.834219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:47.872116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:47.872987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:47.873581 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:47.874239 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lazy-loading 'fault' on Instance uuid 7fa31986-0501-4c2b-a261-04ff2fc14bc6 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:47.923884 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:47.933648 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8f923101-d362-414c-8e89-3b60d1fb9885 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 200 len: 1331 microversion: 2.1 time: 0.117520 Aug 24 05:51:47.938999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 381/755] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:47 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:48.954694 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:48.955308 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:48.962967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:48.963458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:48.964463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:48.964649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:48.965132 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:48.965564 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:48.979412 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 HTTP/1.1 Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:51:48.981105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:51:48.982682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '7fa31986-0501-4c2b-a261-04ff2fc14bc6'} Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:51:48.983579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:51:48.984919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:51:48.986041 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:51:48.986041 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-35fa1bf6-086c-4d28-a887-c0b9af960005 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 404 len: 111 microversion: 2.1 time: 0.031783 Aug 24 05:51:48.986041 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 375/756] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:48 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:51:48.992078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-60a6ed09-6693-47a5-a0a5-9bb3f54195ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '.version_select at 0x7f065c11d9d0>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:49.075195 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-60a6ed09-6693-47a5-a0a5-9bb3f54195ff tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-219933012" status: 202 len: 0 microversion: 2.1 time: 0.087635 Aug 24 05:51:49.075779 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 382/757] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 24 05:51:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-219933012 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:51:49.953445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9b38563c-c1c8-4be0-8545-5c2ad3f9fee0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:49.953996 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9b38563c-c1c8-4be0-8545-5c2ad3f9fee0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:49.961388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b38563c-c1c8-4be0-8545-5c2ad3f9fee0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:49.961968 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b38563c-c1c8-4be0-8545-5c2ad3f9fee0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:49.962302 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b38563c-c1c8-4be0-8545-5c2ad3f9fee0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:49.963637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b38563c-c1c8-4be0-8545-5c2ad3f9fee0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:49.963637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b38563c-c1c8-4be0-8545-5c2ad3f9fee0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:49.963872 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b38563c-c1c8-4be0-8545-5c2ad3f9fee0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:50.088781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-9b38563c-c1c8-4be0-8545-5c2ad3f9fee0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lazy-loading 'services' on Instance uuid 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:50.351920 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9b38563c-c1c8-4be0-8545-5c2ad3f9fee0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-volume_attachments/4e96c29e-a64c-4087-9ab1-2b8146b1fb76" status: 202 len: 0 microversion: 2.1 time: 0.402061 Aug 24 05:51:50.352474 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 376/758] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 05:51:49 2022] DELETE /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-volume_attachments/4e96c29e-a64c-4087-9ab1-2b8146b1fb76 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:51:50.361776 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-28bdde2c-4fd5-4c26-bba0-f23728950791 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:50.363882 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-28bdde2c-4fd5-4c26-bba0-f23728950791 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:50.370692 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28bdde2c-4fd5-4c26-bba0-f23728950791 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:50.371180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28bdde2c-4fd5-4c26-bba0-f23728950791 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:50.371625 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28bdde2c-4fd5-4c26-bba0-f23728950791 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:50.372330 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28bdde2c-4fd5-4c26-bba0-f23728950791 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:50.372823 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28bdde2c-4fd5-4c26-bba0-f23728950791 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:50.373249 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28bdde2c-4fd5-4c26-bba0-f23728950791 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:50.404171 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-28bdde2c-4fd5-4c26-bba0-f23728950791 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047001 Aug 24 05:51:50.404758 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 383/759] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:50 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:51.417343 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9ac6883d-dd50-4bd7-920b-20b5c2775025 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:51.419671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9ac6883d-dd50-4bd7-920b-20b5c2775025 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:51.427026 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ac6883d-dd50-4bd7-920b-20b5c2775025 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:51.427679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ac6883d-dd50-4bd7-920b-20b5c2775025 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:51.427946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ac6883d-dd50-4bd7-920b-20b5c2775025 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:51.428674 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ac6883d-dd50-4bd7-920b-20b5c2775025 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:51.429140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ac6883d-dd50-4bd7-920b-20b5c2775025 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:51.439856 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9ac6883d-dd50-4bd7-920b-20b5c2775025 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:51.460979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9ac6883d-dd50-4bd7-920b-20b5c2775025 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047866 Aug 24 05:51:51.461583 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 377/760] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:51 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:51:52.473075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-183873a4-4864-427c-b348-11ac0dd476c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:52.475169 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-183873a4-4864-427c-b348-11ac0dd476c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:52.481687 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-183873a4-4864-427c-b348-11ac0dd476c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:52.482167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-183873a4-4864-427c-b348-11ac0dd476c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:52.482607 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-183873a4-4864-427c-b348-11ac0dd476c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:52.483298 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-183873a4-4864-427c-b348-11ac0dd476c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:52.483754 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-183873a4-4864-427c-b348-11ac0dd476c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:52.484179 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-183873a4-4864-427c-b348-11ac0dd476c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:52.514217 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-183873a4-4864-427c-b348-11ac0dd476c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045192 Aug 24 05:51:52.514798 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 384/761] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:52 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:51:52.578178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f96ad1f6-329b-42dc-875c-839473a12090 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:52.578774 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f96ad1f6-329b-42dc-875c-839473a12090 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:52.584937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f96ad1f6-329b-42dc-875c-839473a12090 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:52.585418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f96ad1f6-329b-42dc-875c-839473a12090 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:52.585853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f96ad1f6-329b-42dc-875c-839473a12090 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:52.586540 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f96ad1f6-329b-42dc-875c-839473a12090 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:52.586995 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f96ad1f6-329b-42dc-875c-839473a12090 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:52.587417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f96ad1f6-329b-42dc-875c-839473a12090 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:52.611934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f96ad1f6-329b-42dc-875c-839473a12090 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:51:52.733222 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:52.940846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f96ad1f6-329b-42dc-875c-839473a12090 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 204 len: 0 microversion: 2.1 time: 0.367198 Aug 24 05:51:52.941704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 378/762] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:51:52 2022] DELETE /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:51:52.950639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e694fa5e-0a92-4baf-af81-b1c1c9588d5c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:52.951250 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e694fa5e-0a92-4baf-af81-b1c1c9588d5c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:52.957180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e694fa5e-0a92-4baf-af81-b1c1c9588d5c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:52.957661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e694fa5e-0a92-4baf-af81-b1c1c9588d5c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:52.958669 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e694fa5e-0a92-4baf-af81-b1c1c9588d5c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:52.959528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e694fa5e-0a92-4baf-af81-b1c1c9588d5c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:52.959987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e694fa5e-0a92-4baf-af81-b1c1c9588d5c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:52.960464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e694fa5e-0a92-4baf-af81-b1c1c9588d5c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:53.095871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e694fa5e-0a92-4baf-af81-b1c1c9588d5c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:53.104428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e694fa5e-0a92-4baf-af81-b1c1c9588d5c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1681 microversion: 2.1 time: 0.157749 Aug 24 05:51:53.104992 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 385/763] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:52 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:54.126535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-baf1545d-84f9-4e99-89cd-220f292421a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:54.127246 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-baf1545d-84f9-4e99-89cd-220f292421a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:54.134528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-baf1545d-84f9-4e99-89cd-220f292421a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:54.135018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-baf1545d-84f9-4e99-89cd-220f292421a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:54.135459 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-baf1545d-84f9-4e99-89cd-220f292421a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:54.136161 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-baf1545d-84f9-4e99-89cd-220f292421a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:54.136651 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-baf1545d-84f9-4e99-89cd-220f292421a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:54.137083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-baf1545d-84f9-4e99-89cd-220f292421a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:54.269414 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-baf1545d-84f9-4e99-89cd-220f292421a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:54.279183 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-baf1545d-84f9-4e99-89cd-220f292421a0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1681 microversion: 2.1 time: 0.156797 Aug 24 05:51:54.280808 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 379/764] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:54 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:55.035125 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-b4601157-7d40-4e45-ae12-3c6906d049a6 req-98f7c34b-dea9-4132-b3d7-a709c9808f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f94c1e2-6b5c-4d47-bb02-b4c49642dd15", "name": "network-vif-deleted", "tag": "3fa886a1-f7b6-41b0-a537-6f9e71b1139c"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:55.042719 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:55.046883 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b4601157-7d40-4e45-ae12-3c6906d049a6 req-98f7c34b-dea9-4132-b3d7-a709c9808f04 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:55.047437 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b4601157-7d40-4e45-ae12-3c6906d049a6 req-98f7c34b-dea9-4132-b3d7-a709c9808f04 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:55.047875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b4601157-7d40-4e45-ae12-3c6906d049a6 req-98f7c34b-dea9-4132-b3d7-a709c9808f04 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:55.060378 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-b4601157-7d40-4e45-ae12-3c6906d049a6 req-98f7c34b-dea9-4132-b3d7-a709c9808f04 service nova] Creating event network-vif-deleted:3fa886a1-f7b6-41b0-a537-6f9e71b1139c for instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 on hv-cinder-85426 Aug 24 05:51:55.066615 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-b4601157-7d40-4e45-ae12-3c6906d049a6 req-98f7c34b-dea9-4132-b3d7-a709c9808f04 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034805 Aug 24 05:51:55.066916 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 386/765] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:55.301334 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c4193dc2-5933-4f82-a412-84cdf3b95fd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:55.302546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c4193dc2-5933-4f82-a412-84cdf3b95fd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:55.309185 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c4193dc2-5933-4f82-a412-84cdf3b95fd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:55.309663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c4193dc2-5933-4f82-a412-84cdf3b95fd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:55.310097 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c4193dc2-5933-4f82-a412-84cdf3b95fd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:55.310787 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c4193dc2-5933-4f82-a412-84cdf3b95fd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:55.311273 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c4193dc2-5933-4f82-a412-84cdf3b95fd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:55.311694 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c4193dc2-5933-4f82-a412-84cdf3b95fd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:55.375554 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c4193dc2-5933-4f82-a412-84cdf3b95fd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:55.383898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c4193dc2-5933-4f82-a412-84cdf3b95fd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 200 len: 1326 microversion: 2.1 time: 0.086664 Aug 24 05:51:55.384509 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 380/766] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:55 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:56.407180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:56.407984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:56.418165 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:56.418653 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:56.419093 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:56.419793 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:56.420295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:56.420753 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:56.434858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 HTTP/1.1 Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:51:56.436580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:51:56.438153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '5f94c1e2-6b5c-4d47-bb02-b4c49642dd15'} Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:51:56.439087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:51:56.440585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:51:56.441973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:51:56.441973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5cd00c5a-932f-41fe-b244-69cee51071c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 404 len: 111 microversion: 2.1 time: 0.035167 Aug 24 05:51:56.441973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 387/767] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:56 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:51:56.447573 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-23909f14-f4dd-4b09-861b-e74e5d935c8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '.version_select at 0x7f065c026ca0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:56.452218 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR oslo.messaging._drivers.impl_rabbit [None req-23909f14-f4dd-4b09-861b-e74e5d935c8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [56afe969-a03b-4324-81cd-d737d481e3df] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:51:57.460135 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [None req-23909f14-f4dd-4b09-861b-e74e5d935c8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [56afe969-a03b-4324-81cd-d737d481e3df] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 51022. Aug 24 05:51:57.466271 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:57.560638 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-23909f14-f4dd-4b09-861b-e74e5d935c8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-907806558" status: 202 len: 0 microversion: 2.1 time: 1.116683 Aug 24 05:51:57.561215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 381/768] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 24 05:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-907806558 => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:51:58.418191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-98d63ec4-db24-4da0-8c97-b244f9d7fb81 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: .version_select at 0x7f065c05d670>, body: {"keypair": {"name": "tempest-keypair-63496810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsZ/TDbkwdIAg/OIf7AuoTElLJ/p50w5QaExJtOy9lzQ7fllJGdbBQHfJW+l2L+XzT6grvU5ZtXAbPg3Ii8lMcSLkac92FXxj+YIY45XNZXQVDz5J6Qg7TVPJLIgiZpJQ=="}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:58.434492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-98d63ec4-db24-4da0-8c97-b244f9d7fb81 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:51:58.438225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-98d63ec4-db24-4da0-8c97-b244f9d7fb81 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for user d3e6e20d5cd44444b43b1e7abb240f8d and project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:51:58.515349 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-98d63ec4-db24-4da0-8c97-b244f9d7fb81 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.101229 Aug 24 05:51:58.515972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 388/769] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 24 05:51:58 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:00.747143 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1446901829", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf3d5dbf-6bc3-460c-95aa-1bef35e2fd6f"}], "security_groups": [{"name": "tempest-securitygroup--1808857703"}], "key_name": "tempest-keypair-63496810", "user_data": "}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:00.853961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] validate_networks() for [('cf3d5dbf-6bc3-460c-95aa-1bef35e2fd6f', None, None, None, None, None)] {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:52:01.241246 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:52:01.241685 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:52:01.242180 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:52:01.242584 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:52:01.242990 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:52:01.252430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:01.252911 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:01.253342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:01.254054 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:01.255025 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:01.255751 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:01.273294 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:52:01.277393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for user d3e6e20d5cd44444b43b1e7abb240f8d and project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:52:01.288687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:52:01.290932 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:52:01.411457 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7fd57b06-b72c-419c-aedb-b60b479ac73e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.668779 Aug 24 05:52:01.412124 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 382/770] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:52:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:52:01.423361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b87095cb-1641-44cf-900d-6d3a1467076b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:01.423985 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b87095cb-1641-44cf-900d-6d3a1467076b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:01.485765 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b87095cb-1641-44cf-900d-6d3a1467076b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:01.493359 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b87095cb-1641-44cf-900d-6d3a1467076b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1240 microversion: 2.1 time: 0.074146 Aug 24 05:52:01.493867 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 389/771] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:01 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:02.517197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f53260ac-fcd9-44b3-bf06-51a517dcc218 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:02.517788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f53260ac-fcd9-44b3-bf06-51a517dcc218 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:02.527704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f53260ac-fcd9-44b3-bf06-51a517dcc218 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:02.532484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f53260ac-fcd9-44b3-bf06-51a517dcc218 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:02.532484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f53260ac-fcd9-44b3-bf06-51a517dcc218 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:02.532484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f53260ac-fcd9-44b3-bf06-51a517dcc218 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:02.532484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f53260ac-fcd9-44b3-bf06-51a517dcc218 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:02.532830 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f53260ac-fcd9-44b3-bf06-51a517dcc218 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:02.593134 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f53260ac-fcd9-44b3-bf06-51a517dcc218 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:02.601041 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f53260ac-fcd9-44b3-bf06-51a517dcc218 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1244 microversion: 2.1 time: 0.087902 Aug 24 05:52:02.601601 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 383/772] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:02 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:03.621877 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b92ecc2b-985b-4b55-801a-80ac14874b75 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:03.623221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b92ecc2b-985b-4b55-801a-80ac14874b75 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:03.630110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b92ecc2b-985b-4b55-801a-80ac14874b75 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:03.630597 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b92ecc2b-985b-4b55-801a-80ac14874b75 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:03.631082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b92ecc2b-985b-4b55-801a-80ac14874b75 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:03.631786 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b92ecc2b-985b-4b55-801a-80ac14874b75 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:03.632983 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b92ecc2b-985b-4b55-801a-80ac14874b75 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:03.633410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b92ecc2b-985b-4b55-801a-80ac14874b75 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:03.700447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b92ecc2b-985b-4b55-801a-80ac14874b75 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:03.709154 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b92ecc2b-985b-4b55-801a-80ac14874b75 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1300 microversion: 2.1 time: 0.091266 Aug 24 05:52:03.715003 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 390/773] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:03 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:04.730863 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-41c6badc-9905-4b59-846f-5cd8a99798e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:04.731410 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-41c6badc-9905-4b59-846f-5cd8a99798e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:04.738232 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41c6badc-9905-4b59-846f-5cd8a99798e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:04.738731 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41c6badc-9905-4b59-846f-5cd8a99798e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:04.739267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41c6badc-9905-4b59-846f-5cd8a99798e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:04.739977 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41c6badc-9905-4b59-846f-5cd8a99798e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:04.740468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41c6badc-9905-4b59-846f-5cd8a99798e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:04.740902 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41c6badc-9905-4b59-846f-5cd8a99798e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:04.874414 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-41c6badc-9905-4b59-846f-5cd8a99798e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:04.882871 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-41c6badc-9905-4b59-846f-5cd8a99798e7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1366 microversion: 2.1 time: 0.156122 Aug 24 05:52:04.883456 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 384/774] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:04 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:05.263224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-43707d5a-6e8c-4f88-8b8d-dc85734bd991 req-1ca3bb00-0049-467f-b268-277890938f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37f911fc-26ef-4d88-a68f-68413310a1dc", "tag": "188f2894-ead0-4877-a3d5-4f06bfdf2291"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:05.275092 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-43707d5a-6e8c-4f88-8b8d-dc85734bd991 req-1ca3bb00-0049-467f-b268-277890938f9b service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:05.276123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-43707d5a-6e8c-4f88-8b8d-dc85734bd991 req-1ca3bb00-0049-467f-b268-277890938f9b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:05.276598 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-43707d5a-6e8c-4f88-8b8d-dc85734bd991 req-1ca3bb00-0049-467f-b268-277890938f9b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:05.289101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-43707d5a-6e8c-4f88-8b8d-dc85734bd991 req-1ca3bb00-0049-467f-b268-277890938f9b service nova] Creating event network-changed:188f2894-ead0-4877-a3d5-4f06bfdf2291 for instance 37f911fc-26ef-4d88-a68f-68413310a1dc on hv-cinder-85426 Aug 24 05:52:05.294582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-43707d5a-6e8c-4f88-8b8d-dc85734bd991 req-1ca3bb00-0049-467f-b268-277890938f9b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036173 Aug 24 05:52:05.295207 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 391/775] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:05.912707 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9003e2f2-aff2-4a6e-aff8-b61790a4a2ad tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:05.913793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9003e2f2-aff2-4a6e-aff8-b61790a4a2ad tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:05.925870 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9003e2f2-aff2-4a6e-aff8-b61790a4a2ad tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:05.926905 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9003e2f2-aff2-4a6e-aff8-b61790a4a2ad tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:05.928212 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9003e2f2-aff2-4a6e-aff8-b61790a4a2ad tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:05.929418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9003e2f2-aff2-4a6e-aff8-b61790a4a2ad tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:05.929897 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9003e2f2-aff2-4a6e-aff8-b61790a4a2ad tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:05.930344 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9003e2f2-aff2-4a6e-aff8-b61790a4a2ad tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:06.090577 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9003e2f2-aff2-4a6e-aff8-b61790a4a2ad tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:06.103569 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9003e2f2-aff2-4a6e-aff8-b61790a4a2ad tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1366 microversion: 2.1 time: 0.197088 Aug 24 05:52:06.105794 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 385/776] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:05 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:52:07.127721 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-263a9fbc-0d75-44cb-b540-89a48cd9f6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:07.128444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-263a9fbc-0d75-44cb-b540-89a48cd9f6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:07.136148 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-263a9fbc-0d75-44cb-b540-89a48cd9f6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:07.136669 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-263a9fbc-0d75-44cb-b540-89a48cd9f6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:07.137111 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-263a9fbc-0d75-44cb-b540-89a48cd9f6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:07.137803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-263a9fbc-0d75-44cb-b540-89a48cd9f6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:07.138260 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-263a9fbc-0d75-44cb-b540-89a48cd9f6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:07.138688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-263a9fbc-0d75-44cb-b540-89a48cd9f6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:07.272277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-263a9fbc-0d75-44cb-b540-89a48cd9f6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:07.280000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-263a9fbc-0d75-44cb-b540-89a48cd9f6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1366 microversion: 2.1 time: 0.156565 Aug 24 05:52:07.280592 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 392/777] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:07 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:08.301950 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7ff86004-1e2b-445e-82c1-3ba20a955c3c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:08.302554 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7ff86004-1e2b-445e-82c1-3ba20a955c3c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:08.309013 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ff86004-1e2b-445e-82c1-3ba20a955c3c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:08.309487 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ff86004-1e2b-445e-82c1-3ba20a955c3c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:08.309944 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ff86004-1e2b-445e-82c1-3ba20a955c3c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:08.310628 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ff86004-1e2b-445e-82c1-3ba20a955c3c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:08.311075 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ff86004-1e2b-445e-82c1-3ba20a955c3c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:08.311495 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ff86004-1e2b-445e-82c1-3ba20a955c3c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:08.441464 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7ff86004-1e2b-445e-82c1-3ba20a955c3c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:08.449730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7ff86004-1e2b-445e-82c1-3ba20a955c3c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1366 microversion: 2.1 time: 0.151856 Aug 24 05:52:08.450298 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 386/778] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:08 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:09.471012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6e133dd5-d6f5-4661-9bef-50f4ca4467d1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:09.471550 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6e133dd5-d6f5-4661-9bef-50f4ca4467d1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:09.478161 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e133dd5-d6f5-4661-9bef-50f4ca4467d1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:09.478648 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e133dd5-d6f5-4661-9bef-50f4ca4467d1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:09.479086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e133dd5-d6f5-4661-9bef-50f4ca4467d1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:09.479784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e133dd5-d6f5-4661-9bef-50f4ca4467d1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:09.480241 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e133dd5-d6f5-4661-9bef-50f4ca4467d1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:09.480703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e133dd5-d6f5-4661-9bef-50f4ca4467d1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:09.614823 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6e133dd5-d6f5-4661-9bef-50f4ca4467d1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:09.622470 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6e133dd5-d6f5-4661-9bef-50f4ca4467d1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1366 microversion: 2.1 time: 0.155492 Aug 24 05:52:09.623032 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 393/779] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:09 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:10.651190 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4ae07e60-e082-4270-a191-6a8060f6ab3d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:10.651827 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4ae07e60-e082-4270-a191-6a8060f6ab3d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:10.661455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ae07e60-e082-4270-a191-6a8060f6ab3d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:10.662126 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ae07e60-e082-4270-a191-6a8060f6ab3d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:10.662593 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ae07e60-e082-4270-a191-6a8060f6ab3d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:10.663289 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ae07e60-e082-4270-a191-6a8060f6ab3d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:10.663735 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ae07e60-e082-4270-a191-6a8060f6ab3d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:10.664163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ae07e60-e082-4270-a191-6a8060f6ab3d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:10.795748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4ae07e60-e082-4270-a191-6a8060f6ab3d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:10.803804 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4ae07e60-e082-4270-a191-6a8060f6ab3d tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1366 microversion: 2.1 time: 0.159533 Aug 24 05:52:10.804417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 387/780] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:10 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:11.824233 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-30aa7c39-e91f-429a-9646-f0cfa8b383af tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:11.824862 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-30aa7c39-e91f-429a-9646-f0cfa8b383af tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:11.827336 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=6 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:11.832031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30aa7c39-e91f-429a-9646-f0cfa8b383af tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:11.833229 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30aa7c39-e91f-429a-9646-f0cfa8b383af tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:11.833740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30aa7c39-e91f-429a-9646-f0cfa8b383af tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:11.834408 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30aa7c39-e91f-429a-9646-f0cfa8b383af tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:11.834885 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30aa7c39-e91f-429a-9646-f0cfa8b383af tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:11.835298 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-30aa7c39-e91f-429a-9646-f0cfa8b383af tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:11.968118 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-30aa7c39-e91f-429a-9646-f0cfa8b383af tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:11.977076 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-30aa7c39-e91f-429a-9646-f0cfa8b383af tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1366 microversion: 2.1 time: 0.156663 Aug 24 05:52:11.977678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 394/781] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:11 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:12.998239 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8cb721a9-3f03-4cfa-b6d8-bda6aad88bd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:12.998804 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8cb721a9-3f03-4cfa-b6d8-bda6aad88bd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:13.000676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:13.001352 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=6 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:13.006611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8cb721a9-3f03-4cfa-b6d8-bda6aad88bd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:13.007093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8cb721a9-3f03-4cfa-b6d8-bda6aad88bd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:13.007547 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8cb721a9-3f03-4cfa-b6d8-bda6aad88bd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:13.008241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8cb721a9-3f03-4cfa-b6d8-bda6aad88bd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:13.008782 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8cb721a9-3f03-4cfa-b6d8-bda6aad88bd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:13.009213 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8cb721a9-3f03-4cfa-b6d8-bda6aad88bd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:13.136303 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8cb721a9-3f03-4cfa-b6d8-bda6aad88bd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:13.143980 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8cb721a9-3f03-4cfa-b6d8-bda6aad88bd6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1366 microversion: 2.1 time: 0.149743 Aug 24 05:52:13.144572 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 388/782] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:12 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:13.605509 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-9f3dba15-0ed0-49ba-85b5-078e109a2065 req-ba7d6268-d5cf-40a3-afc8-bd9d40c592a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f911fc-26ef-4d88-a68f-68413310a1dc", "name": "network-vif-plugged", "status": "completed", "tag": "188f2894-ead0-4877-a3d5-4f06bfdf2291"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:13.616137 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-9f3dba15-0ed0-49ba-85b5-078e109a2065 req-ba7d6268-d5cf-40a3-afc8-bd9d40c592a9 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:13.616649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-9f3dba15-0ed0-49ba-85b5-078e109a2065 req-ba7d6268-d5cf-40a3-afc8-bd9d40c592a9 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:13.617082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-9f3dba15-0ed0-49ba-85b5-078e109a2065 req-ba7d6268-d5cf-40a3-afc8-bd9d40c592a9 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:13.628704 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-9f3dba15-0ed0-49ba-85b5-078e109a2065 req-ba7d6268-d5cf-40a3-afc8-bd9d40c592a9 service nova] Creating event network-vif-plugged:188f2894-ead0-4877-a3d5-4f06bfdf2291 for instance 37f911fc-26ef-4d88-a68f-68413310a1dc on hv-cinder-85426 Aug 24 05:52:13.634567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-9f3dba15-0ed0-49ba-85b5-078e109a2065 req-ba7d6268-d5cf-40a3-afc8-bd9d40c592a9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032695 Aug 24 05:52:13.635290 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 395/783] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:52:14.165599 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-77c81d87-ae73-4966-b47e-228812e0616b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:14.166211 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-77c81d87-ae73-4966-b47e-228812e0616b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:14.172863 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77c81d87-ae73-4966-b47e-228812e0616b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:14.173340 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77c81d87-ae73-4966-b47e-228812e0616b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:14.173770 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77c81d87-ae73-4966-b47e-228812e0616b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:14.174448 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77c81d87-ae73-4966-b47e-228812e0616b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:14.174896 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77c81d87-ae73-4966-b47e-228812e0616b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:14.175316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77c81d87-ae73-4966-b47e-228812e0616b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:14.307401 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-77c81d87-ae73-4966-b47e-228812e0616b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:14.314913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-77c81d87-ae73-4966-b47e-228812e0616b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1366 microversion: 2.1 time: 0.153190 Aug 24 05:52:14.315480 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 389/784] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:14 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:15.337075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8c46ee19-f8fc-43ff-8a72-96028e002b7f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:15.337778 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8c46ee19-f8fc-43ff-8a72-96028e002b7f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:15.343921 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8c46ee19-f8fc-43ff-8a72-96028e002b7f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:15.344428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8c46ee19-f8fc-43ff-8a72-96028e002b7f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:15.344953 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8c46ee19-f8fc-43ff-8a72-96028e002b7f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:15.345566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8c46ee19-f8fc-43ff-8a72-96028e002b7f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:15.346022 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8c46ee19-f8fc-43ff-8a72-96028e002b7f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:15.346445 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8c46ee19-f8fc-43ff-8a72-96028e002b7f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:15.349860 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=72 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:15.482577 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8c46ee19-f8fc-43ff-8a72-96028e002b7f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:15.490259 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8c46ee19-f8fc-43ff-8a72-96028e002b7f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1366 microversion: 2.1 time: 0.158421 Aug 24 05:52:15.490823 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 396/785] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:15 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:16.510739 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ea23194d-fd59-4411-abc3-1f4656774734 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:16.511340 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ea23194d-fd59-4411-abc3-1f4656774734 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:16.517792 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea23194d-fd59-4411-abc3-1f4656774734 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:16.518317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea23194d-fd59-4411-abc3-1f4656774734 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:16.518698 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea23194d-fd59-4411-abc3-1f4656774734 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:16.519385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea23194d-fd59-4411-abc3-1f4656774734 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:16.520547 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea23194d-fd59-4411-abc3-1f4656774734 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:16.523379 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea23194d-fd59-4411-abc3-1f4656774734 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:16.655760 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ea23194d-fd59-4411-abc3-1f4656774734 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:16.664249 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ea23194d-fd59-4411-abc3-1f4656774734 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1557 microversion: 2.1 time: 0.157406 Aug 24 05:52:16.664890 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 390/786] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:16 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:16.685033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e8bfce62-4858-4930-a851-a52984ec32c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:16.685592 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e8bfce62-4858-4930-a851-a52984ec32c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:16.692257 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bfce62-4858-4930-a851-a52984ec32c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:16.692840 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bfce62-4858-4930-a851-a52984ec32c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:16.693281 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bfce62-4858-4930-a851-a52984ec32c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:16.693982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bfce62-4858-4930-a851-a52984ec32c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:16.694440 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bfce62-4858-4930-a851-a52984ec32c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:16.694889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bfce62-4858-4930-a851-a52984ec32c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:16.772654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e8bfce62-4858-4930-a851-a52984ec32c7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091206 Aug 24 05:52:16.773470 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 397/787] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 24 05:52:16 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:18.020479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-b7c6e028-1ab4-4c94-a1d0-0d367ec3122a req-55190630-6341-4845-be4f-55fe07d89883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37f911fc-26ef-4d88-a68f-68413310a1dc", "tag": "188f2894-ead0-4877-a3d5-4f06bfdf2291"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:18.031801 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-b7c6e028-1ab4-4c94-a1d0-0d367ec3122a req-55190630-6341-4845-be4f-55fe07d89883 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:18.032513 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-b7c6e028-1ab4-4c94-a1d0-0d367ec3122a req-55190630-6341-4845-be4f-55fe07d89883 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:18.032934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-b7c6e028-1ab4-4c94-a1d0-0d367ec3122a req-55190630-6341-4845-be4f-55fe07d89883 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:18.045702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-b7c6e028-1ab4-4c94-a1d0-0d367ec3122a req-55190630-6341-4845-be4f-55fe07d89883 service nova] Creating event network-changed:188f2894-ead0-4877-a3d5-4f06bfdf2291 for instance 37f911fc-26ef-4d88-a68f-68413310a1dc on hv-cinder-85426 Aug 24 05:52:18.051752 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-b7c6e028-1ab4-4c94-a1d0-0d367ec3122a req-55190630-6341-4845-be4f-55fe07d89883 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035520 Aug 24 05:52:18.052355 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 391/788] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:56.419497 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:56.420246 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=9 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:56.424409 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8d2468fb-a23e-4c8e-9662-3a7e1ac4c620 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:56.427678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8d2468fb-a23e-4c8e-9662-3a7e1ac4c620 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:56.431604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d2468fb-a23e-4c8e-9662-3a7e1ac4c620 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:56.432080 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d2468fb-a23e-4c8e-9662-3a7e1ac4c620 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:56.432546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d2468fb-a23e-4c8e-9662-3a7e1ac4c620 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:56.433236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d2468fb-a23e-4c8e-9662-3a7e1ac4c620 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:56.433684 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d2468fb-a23e-4c8e-9662-3a7e1ac4c620 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:56.434101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d2468fb-a23e-4c8e-9662-3a7e1ac4c620 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:56.459073 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8d2468fb-a23e-4c8e-9662-3a7e1ac4c620 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Going to try to terminate instance {{(pid=127756) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:52:56.764731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8d2468fb-a23e-4c8e-9662-3a7e1ac4c620 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "DELETE /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 204 len: 0 microversion: 2.1 time: 0.346324 Aug 24 05:52:56.765282 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 398/789] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:52:56 2022] DELETE /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:52:56.772164 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:56.772870 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:56.776919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-bc7b3961-0aad-47f7-b1d0-addc7ded49db tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:56.777625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-bc7b3961-0aad-47f7-b1d0-addc7ded49db tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:56.783720 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc7b3961-0aad-47f7-b1d0-addc7ded49db tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:56.784204 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc7b3961-0aad-47f7-b1d0-addc7ded49db tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:56.784681 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc7b3961-0aad-47f7-b1d0-addc7ded49db tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:56.785377 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc7b3961-0aad-47f7-b1d0-addc7ded49db tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:56.785838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc7b3961-0aad-47f7-b1d0-addc7ded49db tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:56.786967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bc7b3961-0aad-47f7-b1d0-addc7ded49db tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:56.932027 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-bc7b3961-0aad-47f7-b1d0-addc7ded49db tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:56.939804 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-bc7b3961-0aad-47f7-b1d0-addc7ded49db tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1577 microversion: 2.1 time: 0.170176 Aug 24 05:52:56.940369 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 392/790] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:56 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:57.963849 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-35576c62-f856-433f-b8db-dfbd420ab11e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:57.964535 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-35576c62-f856-433f-b8db-dfbd420ab11e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:57.970977 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35576c62-f856-433f-b8db-dfbd420ab11e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:57.971458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35576c62-f856-433f-b8db-dfbd420ab11e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:57.971895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35576c62-f856-433f-b8db-dfbd420ab11e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:57.972625 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35576c62-f856-433f-b8db-dfbd420ab11e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:57.973071 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35576c62-f856-433f-b8db-dfbd420ab11e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:57.973490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35576c62-f856-433f-b8db-dfbd420ab11e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:58.103902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-35576c62-f856-433f-b8db-dfbd420ab11e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:58.111606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-35576c62-f856-433f-b8db-dfbd420ab11e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1577 microversion: 2.1 time: 0.152265 Aug 24 05:52:58.112207 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 399/791] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:57 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:59.133229 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-41fa380c-e35d-4a6c-8671-ac4130320c29 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:59.133847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-41fa380c-e35d-4a6c-8671-ac4130320c29 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:59.141684 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41fa380c-e35d-4a6c-8671-ac4130320c29 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:59.142174 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41fa380c-e35d-4a6c-8671-ac4130320c29 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:59.142617 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41fa380c-e35d-4a6c-8671-ac4130320c29 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:59.143312 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41fa380c-e35d-4a6c-8671-ac4130320c29 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:59.143774 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41fa380c-e35d-4a6c-8671-ac4130320c29 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:59.144224 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41fa380c-e35d-4a6c-8671-ac4130320c29 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:59.282357 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-41fa380c-e35d-4a6c-8671-ac4130320c29 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:59.290846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-41fa380c-e35d-4a6c-8671-ac4130320c29 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1577 microversion: 2.1 time: 0.161835 Aug 24 05:52:59.291403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 393/792] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:59 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:00.318360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-55d64792-cc37-40c2-a3e7-79d86389352c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:00.319638 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-55d64792-cc37-40c2-a3e7-79d86389352c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:00.326465 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d64792-cc37-40c2-a3e7-79d86389352c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.326629 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d64792-cc37-40c2-a3e7-79d86389352c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.327012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d64792-cc37-40c2-a3e7-79d86389352c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.327711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d64792-cc37-40c2-a3e7-79d86389352c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.328167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d64792-cc37-40c2-a3e7-79d86389352c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.328642 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d64792-cc37-40c2-a3e7-79d86389352c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.394484 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-55d64792-cc37-40c2-a3e7-79d86389352c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:00.404068 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-55d64792-cc37-40c2-a3e7-79d86389352c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1510 microversion: 2.1 time: 0.089758 Aug 24 05:53:00.404881 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 400/793] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:00 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1510 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:00.418804 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-58684541-0036-4841-915d-554a53aea2a6 req-d371796b-e0d0-4935-a714-29d83049d2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97293205-ac16-434c-bdc0-12c736460ba3", "name": "network-vif-deleted", "tag": "c624c6e8-1b3d-4eb1-9e25-5d73924aaefa"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:00.429557 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-58684541-0036-4841-915d-554a53aea2a6 req-d371796b-e0d0-4935-a714-29d83049d2b7 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.430181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-58684541-0036-4841-915d-554a53aea2a6 req-d371796b-e0d0-4935-a714-29d83049d2b7 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.430654 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-58684541-0036-4841-915d-554a53aea2a6 req-d371796b-e0d0-4935-a714-29d83049d2b7 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.441985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-58684541-0036-4841-915d-554a53aea2a6 req-d371796b-e0d0-4935-a714-29d83049d2b7 service nova] Creating event network-vif-deleted:c624c6e8-1b3d-4eb1-9e25-5d73924aaefa for instance 97293205-ac16-434c-bdc0-12c736460ba3 on hv-cinder-85426 Aug 24 05:53:00.448296 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-58684541-0036-4841-915d-554a53aea2a6 req-d371796b-e0d0-4935-a714-29d83049d2b7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037301 Aug 24 05:53:00.448969 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 394/794] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:01.426453 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:01.427613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:01.434065 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:01.434546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:01.434974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:01.435656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:01.436101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:01.436656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:01.467073 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:01.467561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:01.468106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:01.468666 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lazy-loading 'fault' on Instance uuid 97293205-ac16-434c-bdc0-12c736460ba3 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:01.511140 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:01.518813 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-eed4a7f9-4071-4206-81b8-ac88ced7adc5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 200 len: 1230 microversion: 2.1 time: 0.096245 Aug 24 05:53:01.524086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 401/795] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:01 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:02.543944 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:02.544582 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:02.551039 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:02.551527 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:02.551984 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:02.552705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:02.553168 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:02.553602 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:02.566769 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] HTTP exception thrown: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Request method failure captured: Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 HTTP/1.1 Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbu8dOm3pONZeIx1jm41sC2N19NTM9c2O2gbdu8wWljUb9dfKKLzEQgV6V8eIxiMDIZk8bRAVSGnIv1ojnl-i-wfrjAmSAD5bWbO5xE_bUuADpUEWkm8NZ1lfDs_2A_KrShF9bSCJ5ctj6no6GXNNDfWa2p9q_kagE6Yuy0KpiOIjs0 Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 8e8dbc250d3447ecbd8c7b6df2d10d2c Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-TestVolumeBootPattern-1103499817 Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:53:02.568510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}] Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-TestVolumeBootPattern-1103499817 Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 8e8dbc250d3447ecbd8c7b6df2d10d2c Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-TestVolumeBootPattern-1103499817 Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-TestVolumeBootPattern-1103499817-project Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: b92925514b544fbe9e34326f9c48cb24 Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-TestVolumeBootPattern-1103499817-project Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 05:53:02.570242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '97293205-ac16-434c-bdc0-12c736460ba3'} Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:02.571253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 05:53:02.576443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:02.578001 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Returning 404 to user: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:02.578001 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-eaeb1666-b65a-4dff-93fd-2b87d94481e9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 404 len: 111 microversion: 2.1 time: 0.030910 Aug 24 05:53:02.578001 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 395/796] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:02 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:02.673336 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-724050726", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1642854592", "security_groups": [{"name": "tempest-secgroup-smoke-152603612"}], "block_device_mapping_v2": [{"uuid": "6c8835b7-f9d6-44e2-a10f-2d791bd6ba84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f65f9f7a-ac88-464d-85df-73c9c53a7e50"}]}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:02.787023 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.network.neutron [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] validate_networks() for [('f65f9f7a-ac88-464d-85df-73c9c53a7e50', None, None, None, None, None)] {{(pid=127756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:53:03.233838 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Flavor limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:53:03.234264 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Image limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:53:03.234744 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Flavor pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:53:03.235149 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Image pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:53:03.235559 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:53:03.245495 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:03.245986 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:03.246440 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:03.247188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:03.247646 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:03.248074 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:03.265639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Getting quotas for project 8e8dbc250d3447ecbd8c7b6df2d10d2c. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:53:03.269618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Getting quotas for user b92925514b544fbe9e34326f9c48cb24 and project 8e8dbc250d3447ecbd8c7b6df2d10d2c. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:53:03.329040 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Going to run 1 instances... {{(pid=127756) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:53:03.331123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c8835b7-f9d6-44e2-a10f-2d791bd6ba84',volume_size=None,volume_type=None)] {{(pid=127756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:53:03.708544 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ad8409d7-5f3e-463a-9495-8cc3cfc3d749 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:03.709240 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ad8409d7-5f3e-463a-9495-8cc3cfc3d749 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:03.715787 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ad8409d7-5f3e-463a-9495-8cc3cfc3d749 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:03.716352 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ad8409d7-5f3e-463a-9495-8cc3cfc3d749 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:03.716823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ad8409d7-5f3e-463a-9495-8cc3cfc3d749 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:03.717512 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ad8409d7-5f3e-463a-9495-8cc3cfc3d749 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:03.717966 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ad8409d7-5f3e-463a-9495-8cc3cfc3d749 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:03.718389 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ad8409d7-5f3e-463a-9495-8cc3cfc3d749 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:03.718689 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-dd557c5b-f54b-4903-b3d4-e6e836babd28 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.049493 Aug 24 05:53:03.719506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 402/797] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:53:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:53:03.730445 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-619402bf-318a-42e0-bece-4fed1463a32a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:03.731057 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-619402bf-318a-42e0-bece-4fed1463a32a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:03.795525 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-619402bf-318a-42e0-bece-4fed1463a32a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:03.802831 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-619402bf-318a-42e0-bece-4fed1463a32a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1094 microversion: 2.1 time: 0.076268 Aug 24 05:53:03.804431 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 403/798] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:03 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:03.810250 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-ad8409d7-5f3e-463a-9495-8cc3cfc3d749 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lazy-loading 'services' on Instance uuid 64eb4995-d137-42b3-96b4-1af57d704189 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:04.021191 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ad8409d7-5f3e-463a-9495-8cc3cfc3d749 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "DELETE /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments/b1c66e97-1bff-4aa8-bd0f-f5e97b527934" status: 202 len: 0 microversion: 2.1 time: 0.316465 Aug 24 05:53:04.021956 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 396/799] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 05:53:03 2022] DELETE /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments/b1c66e97-1bff-4aa8-bd0f-f5e97b527934 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:53:04.032543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5572f426-cd73-413c-8fc5-c020533c8103 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:04.034848 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5572f426-cd73-413c-8fc5-c020533c8103 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:04.042295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5572f426-cd73-413c-8fc5-c020533c8103 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.042784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5572f426-cd73-413c-8fc5-c020533c8103 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.043224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5572f426-cd73-413c-8fc5-c020533c8103 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.043934 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5572f426-cd73-413c-8fc5-c020533c8103 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.044389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5572f426-cd73-413c-8fc5-c020533c8103 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.044849 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5572f426-cd73-413c-8fc5-c020533c8103 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.076076 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5572f426-cd73-413c-8fc5-c020533c8103 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047997 Aug 24 05:53:04.076631 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 404/800] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:53:04 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:04.824480 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-746e7669-64d1-4b68-9485-61b81f2e0e1d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:04.825093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-746e7669-64d1-4b68-9485-61b81f2e0e1d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:04.831957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-746e7669-64d1-4b68-9485-61b81f2e0e1d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.832481 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-746e7669-64d1-4b68-9485-61b81f2e0e1d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.833972 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-746e7669-64d1-4b68-9485-61b81f2e0e1d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.835138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-746e7669-64d1-4b68-9485-61b81f2e0e1d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.835265 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-746e7669-64d1-4b68-9485-61b81f2e0e1d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.835755 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-746e7669-64d1-4b68-9485-61b81f2e0e1d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.900630 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-746e7669-64d1-4b68-9485-61b81f2e0e1d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:04.908343 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-746e7669-64d1-4b68-9485-61b81f2e0e1d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1144 microversion: 2.1 time: 0.088645 Aug 24 05:53:04.908943 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 397/801] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:04 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:05.088840 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c708c429-bf1b-47d8-a51f-869e826a44b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:05.090967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c708c429-bf1b-47d8-a51f-869e826a44b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:05.097810 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c708c429-bf1b-47d8-a51f-869e826a44b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:05.098293 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c708c429-bf1b-47d8-a51f-869e826a44b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:05.099696 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c708c429-bf1b-47d8-a51f-869e826a44b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:05.100587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c708c429-bf1b-47d8-a51f-869e826a44b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:05.101056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c708c429-bf1b-47d8-a51f-869e826a44b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:05.101481 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c708c429-bf1b-47d8-a51f-869e826a44b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:05.131775 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c708c429-bf1b-47d8-a51f-869e826a44b1 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046927 Aug 24 05:53:05.132347 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 405/802] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:53:05 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:05.931413 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-77bec3c1-5cde-493e-8222-2cdd3390f564 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:05.932045 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-77bec3c1-5cde-493e-8222-2cdd3390f564 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:05.939304 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77bec3c1-5cde-493e-8222-2cdd3390f564 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:05.939933 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77bec3c1-5cde-493e-8222-2cdd3390f564 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:05.940461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77bec3c1-5cde-493e-8222-2cdd3390f564 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:05.941106 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77bec3c1-5cde-493e-8222-2cdd3390f564 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:05.941565 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77bec3c1-5cde-493e-8222-2cdd3390f564 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:05.942020 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77bec3c1-5cde-493e-8222-2cdd3390f564 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.015752 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-77bec3c1-5cde-493e-8222-2cdd3390f564 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:06.031305 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-77bec3c1-5cde-493e-8222-2cdd3390f564 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1200 microversion: 2.1 time: 0.105022 Aug 24 05:53:06.032286 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 398/803] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:05 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1200 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:06.148000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7970755c-33ad-4e90-81a6-7ec3b11d1696 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:06.148000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7970755c-33ad-4e90-81a6-7ec3b11d1696 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:06.153045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970755c-33ad-4e90-81a6-7ec3b11d1696 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.153165 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970755c-33ad-4e90-81a6-7ec3b11d1696 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.153967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970755c-33ad-4e90-81a6-7ec3b11d1696 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.154685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970755c-33ad-4e90-81a6-7ec3b11d1696 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.155412 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970755c-33ad-4e90-81a6-7ec3b11d1696 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.155729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970755c-33ad-4e90-81a6-7ec3b11d1696 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.197233 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7970755c-33ad-4e90-81a6-7ec3b11d1696 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057583 Aug 24 05:53:06.197628 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 406/804] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:53:06 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:53:06.293221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-89fde5ac-c984-4aa0-98af-dad3f351764d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:06.293714 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-89fde5ac-c984-4aa0-98af-dad3f351764d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:06.300461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89fde5ac-c984-4aa0-98af-dad3f351764d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.300682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89fde5ac-c984-4aa0-98af-dad3f351764d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.302356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89fde5ac-c984-4aa0-98af-dad3f351764d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.302356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89fde5ac-c984-4aa0-98af-dad3f351764d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.302356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89fde5ac-c984-4aa0-98af-dad3f351764d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.303333 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89fde5ac-c984-4aa0-98af-dad3f351764d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.330997 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-89fde5ac-c984-4aa0-98af-dad3f351764d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:53:06.677525 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-89fde5ac-c984-4aa0-98af-dad3f351764d tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "DELETE /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 204 len: 0 microversion: 2.1 time: 0.387520 Aug 24 05:53:06.679323 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 399/805] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:53:06 2022] DELETE /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:53:06.688824 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3d6bfae3-b9cb-4dc0-810a-24b78975c8c8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:06.689659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3d6bfae3-b9cb-4dc0-810a-24b78975c8c8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:06.696086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d6bfae3-b9cb-4dc0-810a-24b78975c8c8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.696570 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d6bfae3-b9cb-4dc0-810a-24b78975c8c8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.697005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d6bfae3-b9cb-4dc0-810a-24b78975c8c8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.697698 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d6bfae3-b9cb-4dc0-810a-24b78975c8c8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.698146 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d6bfae3-b9cb-4dc0-810a-24b78975c8c8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.698568 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d6bfae3-b9cb-4dc0-810a-24b78975c8c8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.846501 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3d6bfae3-b9cb-4dc0-810a-24b78975c8c8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:06.855953 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3d6bfae3-b9cb-4dc0-810a-24b78975c8c8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1688 microversion: 2.1 time: 0.171420 Aug 24 05:53:06.856586 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 407/806] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:06 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:07.054649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-14b3c3b8-c43c-4ef9-bdbb-d03aaae48a08 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:07.055430 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-14b3c3b8-c43c-4ef9-bdbb-d03aaae48a08 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:07.063662 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-71173fe0-d678-4ca4-b359-a895a4b83644 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:07.065800 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-14b3c3b8-c43c-4ef9-bdbb-d03aaae48a08 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.065945 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-71173fe0-d678-4ca4-b359-a895a4b83644 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:07.066074 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-14b3c3b8-c43c-4ef9-bdbb-d03aaae48a08 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.066074 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-14b3c3b8-c43c-4ef9-bdbb-d03aaae48a08 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.066074 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-14b3c3b8-c43c-4ef9-bdbb-d03aaae48a08 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.066074 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-14b3c3b8-c43c-4ef9-bdbb-d03aaae48a08 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.066543 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-14b3c3b8-c43c-4ef9-bdbb-d03aaae48a08 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.072728 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71173fe0-d678-4ca4-b359-a895a4b83644 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.073222 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71173fe0-d678-4ca4-b359-a895a4b83644 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.073696 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71173fe0-d678-4ca4-b359-a895a4b83644 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.074392 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71173fe0-d678-4ca4-b359-a895a4b83644 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.074847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71173fe0-d678-4ca4-b359-a895a4b83644 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.075272 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71173fe0-d678-4ca4-b359-a895a4b83644 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.110885 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-71173fe0-d678-4ca4-b359-a895a4b83644 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments/f9ae71a6-fb3a-4104-af76-b3c9906fcc8b" status: 200 len: 194 microversion: 2.20 time: 0.051533 Aug 24 05:53:07.111590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 408/807] 10.222.0.15 () {60 vars in 1454 bytes} [Wed Aug 24 05:53:07 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments/f9ae71a6-fb3a-4104-af76-b3c9906fcc8b => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:53:07.204634 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5d5ea7d5-bb47-432d-a653-2a1961ac501e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:07.205314 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5d5ea7d5-bb47-432d-a653-2a1961ac501e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:07.213711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7d5-bb47-432d-a653-2a1961ac501e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.214200 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7d5-bb47-432d-a653-2a1961ac501e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.214641 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7d5-bb47-432d-a653-2a1961ac501e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.215349 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7d5-bb47-432d-a653-2a1961ac501e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.215810 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7d5-bb47-432d-a653-2a1961ac501e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.216487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7d5-bb47-432d-a653-2a1961ac501e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.244753 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-14b3c3b8-c43c-4ef9-bdbb-d03aaae48a08 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:07.252679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-14b3c3b8-c43c-4ef9-bdbb-d03aaae48a08 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1277 microversion: 2.1 time: 0.202863 Aug 24 05:53:07.253257 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 400/808] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:07 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:07.311854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-5d5ea7d5-bb47-432d-a653-2a1961ac501e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lazy-loading 'services' on Instance uuid 27d92fba-9c39-4b5f-971f-83d972055316 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:07.610201 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5d5ea7d5-bb47-432d-a653-2a1961ac501e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments/f9ae71a6-fb3a-4104-af76-b3c9906fcc8b" status: 202 len: 0 microversion: 2.20 time: 0.409230 Aug 24 05:53:07.610697 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 409/809] 10.222.0.15 () {60 vars in 1457 bytes} [Wed Aug 24 05:53:07 2022] DELETE /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments/f9ae71a6-fb3a-4104-af76-b3c9906fcc8b => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:53:07.620423 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-fb9cd735-c6cd-4f56-aaa6-ec95a03bb389 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:07.622687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-fb9cd735-c6cd-4f56-aaa6-ec95a03bb389 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:07.628850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb9cd735-c6cd-4f56-aaa6-ec95a03bb389 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.629338 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb9cd735-c6cd-4f56-aaa6-ec95a03bb389 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.629778 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb9cd735-c6cd-4f56-aaa6-ec95a03bb389 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.630492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb9cd735-c6cd-4f56-aaa6-ec95a03bb389 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.631088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb9cd735-c6cd-4f56-aaa6-ec95a03bb389 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.631563 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb9cd735-c6cd-4f56-aaa6-ec95a03bb389 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.662618 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-fb9cd735-c6cd-4f56-aaa6-ec95a03bb389 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047201 Aug 24 05:53:07.663197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 401/810] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 24 05:53:07 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:53:07.885970 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b44e71d5-df88-40fe-9243-5883196d197e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:07.886675 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b44e71d5-df88-40fe-9243-5883196d197e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:07.893034 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b44e71d5-df88-40fe-9243-5883196d197e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.893521 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b44e71d5-df88-40fe-9243-5883196d197e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.893963 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b44e71d5-df88-40fe-9243-5883196d197e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.894653 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b44e71d5-df88-40fe-9243-5883196d197e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.895111 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b44e71d5-df88-40fe-9243-5883196d197e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.895542 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b44e71d5-df88-40fe-9243-5883196d197e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:08.025570 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b44e71d5-df88-40fe-9243-5883196d197e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:08.033472 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b44e71d5-df88-40fe-9243-5883196d197e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1688 microversion: 2.1 time: 0.153137 Aug 24 05:53:08.034071 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 410/811] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:07 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:08.284304 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-983dec9b-33c9-4749-aa59-869e9ac6be1b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:08.284952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-983dec9b-33c9-4749-aa59-869e9ac6be1b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:08.292613 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-983dec9b-33c9-4749-aa59-869e9ac6be1b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:08.293107 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-983dec9b-33c9-4749-aa59-869e9ac6be1b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:08.293551 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-983dec9b-33c9-4749-aa59-869e9ac6be1b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:08.294253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-983dec9b-33c9-4749-aa59-869e9ac6be1b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:08.294708 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-983dec9b-33c9-4749-aa59-869e9ac6be1b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:08.295139 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-983dec9b-33c9-4749-aa59-869e9ac6be1b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:08.428937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-983dec9b-33c9-4749-aa59-869e9ac6be1b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:08.436883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-983dec9b-33c9-4749-aa59-869e9ac6be1b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1277 microversion: 2.1 time: 0.156042 Aug 24 05:53:08.437383 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 402/812] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:08 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:08.675722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4ee2ee1f-d536-4fd1-bdd3-e0fa23c5d3e0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:08.678115 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4ee2ee1f-d536-4fd1-bdd3-e0fa23c5d3e0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:08.684556 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ee2ee1f-d536-4fd1-bdd3-e0fa23c5d3e0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:08.685042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ee2ee1f-d536-4fd1-bdd3-e0fa23c5d3e0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:08.685478 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ee2ee1f-d536-4fd1-bdd3-e0fa23c5d3e0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:08.686162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ee2ee1f-d536-4fd1-bdd3-e0fa23c5d3e0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:08.686616 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ee2ee1f-d536-4fd1-bdd3-e0fa23c5d3e0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:08.687096 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ee2ee1f-d536-4fd1-bdd3-e0fa23c5d3e0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:08.717178 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4ee2ee1f-d536-4fd1-bdd3-e0fa23c5d3e0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045674 Aug 24 05:53:08.717736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 411/813] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 24 05:53:08 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:53:09.057312 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8a347317-d7c0-4aeb-9458-9b658872418e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:09.058963 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8a347317-d7c0-4aeb-9458-9b658872418e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:09.071747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a347317-d7c0-4aeb-9458-9b658872418e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:09.072241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a347317-d7c0-4aeb-9458-9b658872418e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:09.072728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a347317-d7c0-4aeb-9458-9b658872418e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:09.073438 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a347317-d7c0-4aeb-9458-9b658872418e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:09.074021 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a347317-d7c0-4aeb-9458-9b658872418e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:09.074472 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a347317-d7c0-4aeb-9458-9b658872418e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:09.206115 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8a347317-d7c0-4aeb-9458-9b658872418e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:09.213900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8a347317-d7c0-4aeb-9458-9b658872418e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1688 microversion: 2.1 time: 0.161163 Aug 24 05:53:09.214468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 403/814] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:09 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:09.457285 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-55715e2a-d04f-4cb1-a724-67dbd9a5bbb2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:09.457897 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-55715e2a-d04f-4cb1-a724-67dbd9a5bbb2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:09.463999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55715e2a-d04f-4cb1-a724-67dbd9a5bbb2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:09.464513 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55715e2a-d04f-4cb1-a724-67dbd9a5bbb2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:09.464949 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55715e2a-d04f-4cb1-a724-67dbd9a5bbb2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:09.465664 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55715e2a-d04f-4cb1-a724-67dbd9a5bbb2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:09.466119 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55715e2a-d04f-4cb1-a724-67dbd9a5bbb2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:09.466541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55715e2a-d04f-4cb1-a724-67dbd9a5bbb2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:09.637642 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-55715e2a-d04f-4cb1-a724-67dbd9a5bbb2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:09.637642 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-55715e2a-d04f-4cb1-a724-67dbd9a5bbb2 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1277 microversion: 2.1 time: 0.162236 Aug 24 05:53:09.637642 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 412/815] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:09 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:09.730266 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-5bf5d761-37f6-44d6-bae2-8f9ac13bb1c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:09.732540 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5bf5d761-37f6-44d6-bae2-8f9ac13bb1c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:09.738965 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bf5d761-37f6-44d6-bae2-8f9ac13bb1c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:09.739408 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bf5d761-37f6-44d6-bae2-8f9ac13bb1c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:09.739936 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bf5d761-37f6-44d6-bae2-8f9ac13bb1c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:09.752592 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bf5d761-37f6-44d6-bae2-8f9ac13bb1c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:09.752592 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bf5d761-37f6-44d6-bae2-8f9ac13bb1c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:09.752592 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bf5d761-37f6-44d6-bae2-8f9ac13bb1c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:09.773939 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-5bf5d761-37f6-44d6-bae2-8f9ac13bb1c7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047781 Aug 24 05:53:09.774515 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 404/816] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 24 05:53:09 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:53:10.237928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-04257001-79ff-4e1c-92f7-3cf93b5ede18 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:10.239038 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-04257001-79ff-4e1c-92f7-3cf93b5ede18 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:10.250622 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04257001-79ff-4e1c-92f7-3cf93b5ede18 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:10.251512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04257001-79ff-4e1c-92f7-3cf93b5ede18 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:10.252321 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04257001-79ff-4e1c-92f7-3cf93b5ede18 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:10.253603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04257001-79ff-4e1c-92f7-3cf93b5ede18 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:10.254429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04257001-79ff-4e1c-92f7-3cf93b5ede18 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:10.255204 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04257001-79ff-4e1c-92f7-3cf93b5ede18 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:10.291424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:10.423967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-04257001-79ff-4e1c-92f7-3cf93b5ede18 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:10.432359 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-04257001-79ff-4e1c-92f7-3cf93b5ede18 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1688 microversion: 2.1 time: 0.201908 Aug 24 05:53:10.433688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 413/817] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:10 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:10.580254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-68bda18e-b417-4dd8-ac95-a2e1eec8e1b5 req-86abbdde-d422-4fea-a539-76a4791e0720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4809e1f-dcaa-4f5b-833e-5a2490d48732", "tag": "75dbb744-8992-4d1d-8115-b6514fa8aabd"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:10.592709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-68bda18e-b417-4dd8-ac95-a2e1eec8e1b5 req-86abbdde-d422-4fea-a539-76a4791e0720 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:10.594329 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-68bda18e-b417-4dd8-ac95-a2e1eec8e1b5 req-86abbdde-d422-4fea-a539-76a4791e0720 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:10.595104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-68bda18e-b417-4dd8-ac95-a2e1eec8e1b5 req-86abbdde-d422-4fea-a539-76a4791e0720 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:10.617731 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-68bda18e-b417-4dd8-ac95-a2e1eec8e1b5 req-86abbdde-d422-4fea-a539-76a4791e0720 service nova] Creating event network-changed:75dbb744-8992-4d1d-8115-b6514fa8aabd for instance e4809e1f-dcaa-4f5b-833e-5a2490d48732 on hv-cinder-85426 Aug 24 05:53:10.623210 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-68bda18e-b417-4dd8-ac95-a2e1eec8e1b5 req-86abbdde-d422-4fea-a539-76a4791e0720 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046021 Aug 24 05:53:10.624162 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 405/818] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:10.637033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-11f041b5-1bd2-4edf-841e-b3f312bf29ba tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:10.637661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-11f041b5-1bd2-4edf-841e-b3f312bf29ba tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:10.644390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11f041b5-1bd2-4edf-841e-b3f312bf29ba tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:10.644906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11f041b5-1bd2-4edf-841e-b3f312bf29ba tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:10.645344 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11f041b5-1bd2-4edf-841e-b3f312bf29ba tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:10.646229 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11f041b5-1bd2-4edf-841e-b3f312bf29ba tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:10.647410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11f041b5-1bd2-4edf-841e-b3f312bf29ba tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:10.648096 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-11f041b5-1bd2-4edf-841e-b3f312bf29ba tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:10.787590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b0b544b1-7b09-45ce-9f9a-80a6dbe7f599 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:10.789904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b0b544b1-7b09-45ce-9f9a-80a6dbe7f599 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:10.797056 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b544b1-7b09-45ce-9f9a-80a6dbe7f599 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:10.797476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b544b1-7b09-45ce-9f9a-80a6dbe7f599 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:10.797920 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b544b1-7b09-45ce-9f9a-80a6dbe7f599 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:10.798628 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b544b1-7b09-45ce-9f9a-80a6dbe7f599 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:10.799091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b544b1-7b09-45ce-9f9a-80a6dbe7f599 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:10.799519 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b0b544b1-7b09-45ce-9f9a-80a6dbe7f599 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:10.837223 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b0b544b1-7b09-45ce-9f9a-80a6dbe7f599 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054701 Aug 24 05:53:10.837821 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 406/819] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 24 05:53:10 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:53:11.134046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-11f041b5-1bd2-4edf-841e-b3f312bf29ba tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:11.142299 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-11f041b5-1bd2-4edf-841e-b3f312bf29ba tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1277 microversion: 2.1 time: 0.509196 Aug 24 05:53:11.147450 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 414/820] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:10 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1277 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:11.454681 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-22abcb33-79f9-409d-9170-4a7bd6686fd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:11.455321 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-22abcb33-79f9-409d-9170-4a7bd6686fd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:11.462531 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22abcb33-79f9-409d-9170-4a7bd6686fd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:11.463024 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22abcb33-79f9-409d-9170-4a7bd6686fd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:11.463473 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22abcb33-79f9-409d-9170-4a7bd6686fd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:11.464258 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22abcb33-79f9-409d-9170-4a7bd6686fd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:11.464767 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22abcb33-79f9-409d-9170-4a7bd6686fd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:11.465199 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-22abcb33-79f9-409d-9170-4a7bd6686fd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:11.635110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-22abcb33-79f9-409d-9170-4a7bd6686fd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:11.643406 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-22abcb33-79f9-409d-9170-4a7bd6686fd8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1688 microversion: 2.1 time: 0.192659 Aug 24 05:53:11.644341 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 407/821] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:11 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:11.850790 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ff1fa894-2a0b-4d29-a44e-6edd43515e2b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:11.853135 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ff1fa894-2a0b-4d29-a44e-6edd43515e2b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:11.859113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff1fa894-2a0b-4d29-a44e-6edd43515e2b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:11.859581 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff1fa894-2a0b-4d29-a44e-6edd43515e2b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:11.860010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff1fa894-2a0b-4d29-a44e-6edd43515e2b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:11.860737 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff1fa894-2a0b-4d29-a44e-6edd43515e2b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:11.861189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff1fa894-2a0b-4d29-a44e-6edd43515e2b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:11.861603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff1fa894-2a0b-4d29-a44e-6edd43515e2b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:11.892985 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ff1fa894-2a0b-4d29-a44e-6edd43515e2b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046910 Aug 24 05:53:11.896915 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 415/822] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 24 05:53:11 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:11.939858 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-d9a64f87-2c82-4d0f-8ee7-932f935b984f req-8379d16d-71cf-4f5c-8634-ef23d97126f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64eb4995-d137-42b3-96b4-1af57d704189", "name": "network-vif-deleted", "tag": "9f61d38a-f834-4c44-ba42-d2df9d160ab5"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:11.950579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-d9a64f87-2c82-4d0f-8ee7-932f935b984f req-8379d16d-71cf-4f5c-8634-ef23d97126f3 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:11.951071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-d9a64f87-2c82-4d0f-8ee7-932f935b984f req-8379d16d-71cf-4f5c-8634-ef23d97126f3 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:11.951490 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-d9a64f87-2c82-4d0f-8ee7-932f935b984f req-8379d16d-71cf-4f5c-8634-ef23d97126f3 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:11.961102 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0373ec0a-7de3-4ebd-bad2-104dad5a8b33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:11.961600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0373ec0a-7de3-4ebd-bad2-104dad5a8b33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:11.965495 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:11.971132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0373ec0a-7de3-4ebd-bad2-104dad5a8b33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:11.971693 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0373ec0a-7de3-4ebd-bad2-104dad5a8b33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:11.972066 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0373ec0a-7de3-4ebd-bad2-104dad5a8b33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:11.972929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0373ec0a-7de3-4ebd-bad2-104dad5a8b33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:11.973396 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0373ec0a-7de3-4ebd-bad2-104dad5a8b33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:11.973820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0373ec0a-7de3-4ebd-bad2-104dad5a8b33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:11.974200 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-d9a64f87-2c82-4d0f-8ee7-932f935b984f req-8379d16d-71cf-4f5c-8634-ef23d97126f3 service nova] Creating event network-vif-deleted:9f61d38a-f834-4c44-ba42-d2df9d160ab5 for instance 64eb4995-d137-42b3-96b4-1af57d704189 on hv-cinder-85426 Aug 24 05:53:11.979315 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-d9a64f87-2c82-4d0f-8ee7-932f935b984f req-8379d16d-71cf-4f5c-8634-ef23d97126f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042970 Aug 24 05:53:11.982363 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 408/823] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:12.002769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0373ec0a-7de3-4ebd-bad2-104dad5a8b33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Going to try to terminate instance {{(pid=127756) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:53:12.165739 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4dfaed23-c672-45aa-ac03-8ca9e2a1f724 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:12.166975 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4dfaed23-c672-45aa-ac03-8ca9e2a1f724 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:12.175097 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dfaed23-c672-45aa-ac03-8ca9e2a1f724 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:12.179297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dfaed23-c672-45aa-ac03-8ca9e2a1f724 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:12.179297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dfaed23-c672-45aa-ac03-8ca9e2a1f724 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:12.179297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dfaed23-c672-45aa-ac03-8ca9e2a1f724 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:12.179297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dfaed23-c672-45aa-ac03-8ca9e2a1f724 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:12.179697 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dfaed23-c672-45aa-ac03-8ca9e2a1f724 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:12.335684 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4dfaed23-c672-45aa-ac03-8ca9e2a1f724 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:12.343853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4dfaed23-c672-45aa-ac03-8ca9e2a1f724 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.183390 Aug 24 05:53:12.356785 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 409/824] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:12 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:12.404219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0373ec0a-7de3-4ebd-bad2-104dad5a8b33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 204 len: 0 microversion: 2.20 time: 0.447123 Aug 24 05:53:12.405998 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 416/825] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 24 05:53:11 2022] DELETE /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:53:12.416280 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:12.419744 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:12.424024 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:12.424678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:12.425195 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:12.425982 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:12.426452 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:12.426889 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:12.586741 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:12.595492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:12.597082 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:12.598228 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a8717a6e-21e7-4b7e-b99d-f6fb57941c5a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.188140 Aug 24 05:53:12.602888 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 410/826] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:12 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:12.668016 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d8d801e1-5a1a-4644-a19f-147da2ee67bc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:12.669328 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d8d801e1-5a1a-4644-a19f-147da2ee67bc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:12.677726 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8d801e1-5a1a-4644-a19f-147da2ee67bc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:12.678117 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8d801e1-5a1a-4644-a19f-147da2ee67bc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:12.678589 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8d801e1-5a1a-4644-a19f-147da2ee67bc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:12.679290 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8d801e1-5a1a-4644-a19f-147da2ee67bc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:12.679749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8d801e1-5a1a-4644-a19f-147da2ee67bc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:12.680168 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8d801e1-5a1a-4644-a19f-147da2ee67bc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:12.746956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d8d801e1-5a1a-4644-a19f-147da2ee67bc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:12.755115 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d8d801e1-5a1a-4644-a19f-147da2ee67bc tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1330 microversion: 2.1 time: 0.091974 Aug 24 05:53:12.756314 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 417/827] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:12 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:13.366883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a9657425-4669-401b-b4ae-4bd6d7cdb73a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:13.367433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a9657425-4669-401b-b4ae-4bd6d7cdb73a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:13.373966 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a9657425-4669-401b-b4ae-4bd6d7cdb73a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:13.374482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a9657425-4669-401b-b4ae-4bd6d7cdb73a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:13.374882 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a9657425-4669-401b-b4ae-4bd6d7cdb73a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:13.375596 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a9657425-4669-401b-b4ae-4bd6d7cdb73a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:13.376052 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a9657425-4669-401b-b4ae-4bd6d7cdb73a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:13.376531 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a9657425-4669-401b-b4ae-4bd6d7cdb73a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:13.506830 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a9657425-4669-401b-b4ae-4bd6d7cdb73a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:13.515087 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a9657425-4669-401b-b4ae-4bd6d7cdb73a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.152826 Aug 24 05:53:13.515638 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 411/828] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:13 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:13.622355 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:13.622902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:13.625382 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:13.630360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:13.630865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:13.631310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:13.634627 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:13.634627 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:13.634627 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:13.776286 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:13.777747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d2cfc43f-dccb-4fd3-8e25-9b7f104c4032 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:13.778361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d2cfc43f-dccb-4fd3-8e25-9b7f104c4032 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:13.784691 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:13.784912 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2cfc43f-dccb-4fd3-8e25-9b7f104c4032 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:13.785342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2cfc43f-dccb-4fd3-8e25-9b7f104c4032 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:13.785773 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2cfc43f-dccb-4fd3-8e25-9b7f104c4032 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:13.786207 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:13.786552 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2cfc43f-dccb-4fd3-8e25-9b7f104c4032 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:13.787560 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-409c6965-4463-4746-ad99-c39a9c3c98b2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.169292 Aug 24 05:53:13.787851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2cfc43f-dccb-4fd3-8e25-9b7f104c4032 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:13.788135 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 418/829] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:13 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:13.788296 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2cfc43f-dccb-4fd3-8e25-9b7f104c4032 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:13.853532 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d2cfc43f-dccb-4fd3-8e25-9b7f104c4032 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:13.861305 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d2cfc43f-dccb-4fd3-8e25-9b7f104c4032 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1330 microversion: 2.1 time: 0.087681 Aug 24 05:53:13.861876 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 412/830] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:13 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1330 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:14.536349 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d045eca3-b995-4a45-a0b6-c280d46788c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:14.537633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d045eca3-b995-4a45-a0b6-c280d46788c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:14.539464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=8 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:14.544382 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d045eca3-b995-4a45-a0b6-c280d46788c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:14.544903 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d045eca3-b995-4a45-a0b6-c280d46788c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:14.545342 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d045eca3-b995-4a45-a0b6-c280d46788c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:14.546036 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d045eca3-b995-4a45-a0b6-c280d46788c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:14.546492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d045eca3-b995-4a45-a0b6-c280d46788c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:14.547184 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d045eca3-b995-4a45-a0b6-c280d46788c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:14.683841 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d045eca3-b995-4a45-a0b6-c280d46788c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:14.691895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d045eca3-b995-4a45-a0b6-c280d46788c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.159436 Aug 24 05:53:14.704160 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 419/831] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:14 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:14.811317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:14.811942 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:14.819015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:14.819501 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:14.819941 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:14.820659 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:14.821114 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:14.821531 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:14.883325 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:14.884025 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:14.890433 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:14.890959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:14.891594 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:14.892286 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:14.892809 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:14.893326 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:14.927100 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:14.927620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:14.928294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:14.928798 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lazy-loading 'fault' on Instance uuid 64eb4995-d137-42b3-96b4-1af57d704189 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:15.002243 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:15.014033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2ae119a1-8ed7-4e8b-8a35-4979a761a849 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 200 len: 1335 microversion: 2.1 time: 0.135335 Aug 24 05:53:15.014854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 420/832] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:14 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 1335 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:15.089806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:15.100069 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:15.101621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:15.103026 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d2feda66-2256-4249-be59-4b8cd4d7ede2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1722 microversion: 2.20 time: 0.295731 Aug 24 05:53:15.104034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 413/833] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:14 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:15.714070 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-13af2812-984a-442d-b58a-6dba6f3c6771 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:15.714688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-13af2812-984a-442d-b58a-6dba6f3c6771 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:15.721745 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13af2812-984a-442d-b58a-6dba6f3c6771 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:15.722331 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13af2812-984a-442d-b58a-6dba6f3c6771 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:15.722832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13af2812-984a-442d-b58a-6dba6f3c6771 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:15.723626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13af2812-984a-442d-b58a-6dba6f3c6771 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:15.724193 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13af2812-984a-442d-b58a-6dba6f3c6771 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:15.724907 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13af2812-984a-442d-b58a-6dba6f3c6771 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:15.901035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-13af2812-984a-442d-b58a-6dba6f3c6771 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:15.909474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-13af2812-984a-442d-b58a-6dba6f3c6771 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.200350 Aug 24 05:53:15.910041 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 421/834] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:15 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:15.930230 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f0d88c64-45c6-41e6-a7f5-b7fc954619ed tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-824021517"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:15.930788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f0d88c64-45c6-41e6-a7f5-b7fc954619ed tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:15.944891 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-2a8595a1-40c9-419c-8285-9a7db32287b0 req-2a781c0c-9dff-4b8d-8c1b-0492ee53bf4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d92fba-9c39-4b5f-971f-83d972055316", "name": "network-vif-deleted", "tag": "14ce7c9b-e214-4a48-bcb6-c730bc8b2303"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:15.946482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0d88c64-45c6-41e6-a7f5-b7fc954619ed tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:15.947178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0d88c64-45c6-41e6-a7f5-b7fc954619ed tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:15.947795 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0d88c64-45c6-41e6-a7f5-b7fc954619ed tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:15.949368 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0d88c64-45c6-41e6-a7f5-b7fc954619ed tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:15.950145 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0d88c64-45c6-41e6-a7f5-b7fc954619ed tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:15.950738 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f0d88c64-45c6-41e6-a7f5-b7fc954619ed tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:15.968386 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-2a8595a1-40c9-419c-8285-9a7db32287b0 req-2a781c0c-9dff-4b8d-8c1b-0492ee53bf4b service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:15.969159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-2a8595a1-40c9-419c-8285-9a7db32287b0 req-2a781c0c-9dff-4b8d-8c1b-0492ee53bf4b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:15.970557 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-2a8595a1-40c9-419c-8285-9a7db32287b0 req-2a781c0c-9dff-4b8d-8c1b-0492ee53bf4b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:15.985014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-2a8595a1-40c9-419c-8285-9a7db32287b0 req-2a781c0c-9dff-4b8d-8c1b-0492ee53bf4b service nova] Creating event network-vif-deleted:14ce7c9b-e214-4a48-bcb6-c730bc8b2303 for instance 27d92fba-9c39-4b5f-971f-83d972055316 on hv-cinder-85426 Aug 24 05:53:15.992008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-2a8595a1-40c9-419c-8285-9a7db32287b0 req-2a781c0c-9dff-4b8d-8c1b-0492ee53bf4b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054434 Aug 24 05:53:15.993036 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 422/835] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:16.039621 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:16.040482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 64eb4995-d137-42b3-96b4-1af57d704189] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:16.048808 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:16.049518 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:16.050826 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:16.051548 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:16.052677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:16.053386 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:16.069497 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] HTTP exception thrown: Instance 64eb4995-d137-42b3-96b4-1af57d704189 could not be found. Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Request method failure captured: Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 HTTP/1.1 Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrJzcprHqQlE5leVvGfV6xgwH1tOW0OIj8bhIII0tPRpVgD4vrhN0TkXcTjl15pHeEFXnr9AQBXPxDdB2BYsR5TOA76YGfCuwpJD9i-Sssl_bP9CSaMttD_juz07C2hdpqvtLcP6hER3DOwih0w66MhihvnUtIVn_DOGnwbrS6REzc Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 39a99050c88d48db851f437f68b65a58 Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:53:16.071199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_39a99050c88d48db851f437f68b65a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a99050c88d48db851f437f68b65a58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/39a99050c88d48db851f437f68b65a58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a99050c88d48db851f437f68b65a58"}]}] Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 39a99050c88d48db851f437f68b65a58 Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-ServerRescueNegativeTestJSON-1927483895-project Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 926115c2e54741e6a3aca02437309b8f Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1927483895-project Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 64eb4995-d137-42b3-96b4-1af57d704189 could not be found. Aug 24 05:53:16.072880 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '64eb4995-d137-42b3-96b4-1af57d704189'} Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64eb4995-d137-42b3-96b4-1af57d704189 could not be found. Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:16.073847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64eb4995-d137-42b3-96b4-1af57d704189 could not be found. Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64eb4995-d137-42b3-96b4-1af57d704189 could not be found. Aug 24 05:53:16.075486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:16.077725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Returning 404 to user: Instance 64eb4995-d137-42b3-96b4-1af57d704189 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:16.077725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-fb90ee8b-69e3-46fe-a6e5-75db16c253c5 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189" status: 404 len: 111 microversion: 2.1 time: 0.038013 Aug 24 05:53:16.077725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 423/836] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:16 2022] GET /compute/v2.1/servers/64eb4995-d137-42b3-96b4-1af57d704189 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:16.081042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7c53c956-7cc9-400b-9b4d-1462614fe53f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '.version_select at 0x7f065c0d4040>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:16.135092 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.network.security_group_api [None req-f0d88c64-45c6-41e6-a7f5-b7fc954619ed tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Removing security group f3704b79-bbda-4e65-8565-c5b6c8a2ba9d from port 5aeffe0a-e1d3-441b-86b9-7b72a10a2baa Aug 24 05:53:16.164874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7c53c956-7cc9-400b-9b4d-1462614fe53f tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994994310" status: 202 len: 0 microversion: 2.1 time: 0.087359 Aug 24 05:53:16.166310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 424/837] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 24 05:53:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994994310 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:53:16.172856 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:16.173521 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:16.198297 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:16.198797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:16.199242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:16.200017 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:16.200512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:16.200947 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:16.235455 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:16.235862 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:16.236302 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:16.236845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lazy-loading 'fault' on Instance uuid 27d92fba-9c39-4b5f-971f-83d972055316 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:16.289482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:16.299671 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:16.301360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:16.303292 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5cc6fb60-dd74-47c3-a27b-77bea43469f8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 200 len: 1371 microversion: 2.20 time: 0.136022 Aug 24 05:53:16.303959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 425/838] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:16 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 1371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:16.732571 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f0d88c64-45c6-41e6-a7f5-b7fc954619ed tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "POST /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/action" status: 202 len: 0 microversion: 2.1 time: 0.979389 Aug 24 05:53:16.734853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 414/839] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:53:15 2022] POST /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/action => generated 0 bytes in 982 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:53:16.938938 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f47bf6f0-0aa9-4ee2-8154-0df6fc9359ea tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:16.939627 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f47bf6f0-0aa9-4ee2-8154-0df6fc9359ea tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:16.946926 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f47bf6f0-0aa9-4ee2-8154-0df6fc9359ea tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:16.947722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f47bf6f0-0aa9-4ee2-8154-0df6fc9359ea tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:16.949173 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f47bf6f0-0aa9-4ee2-8154-0df6fc9359ea tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:16.950858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f47bf6f0-0aa9-4ee2-8154-0df6fc9359ea tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:16.950858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f47bf6f0-0aa9-4ee2-8154-0df6fc9359ea tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:16.950858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f47bf6f0-0aa9-4ee2-8154-0df6fc9359ea tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:17.329185 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:17.329740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:17.337581 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:17.338090 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:17.338531 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:17.340298 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:17.340806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:17.341237 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:17.357125 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] HTTP exception thrown: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Request method failure captured: Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 HTTP/1.1 Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbsx39bq01s7lnlvC98awDgFA_LGJmOwy5svJIbrtZb9MVi4yhty5UzoKU07LeRfw66z8mqSjqRw0JpaYRExoBDMk4Wa3t7bqfnspm6TeXf8KtNGFHRff2nuK61ISJ4efQjlYQeUUZ4gmJ4nrYlg82GrXhTB3PpRNyxO9PRFqZOrQNs Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:53:17.359034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}] Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: c7ef3bf8dfd342f5a2fef02bf597af90 Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:53:17.360676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '27d92fba-9c39-4b5f-971f-83d972055316'} Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:17.361468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:53:17.363142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:17.365767 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Returning 404 to user: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:17.365767 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-cc9faaf5-2598-48ff-9dd2-365e9ce5357b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 404 len: 111 microversion: 2.20 time: 0.037984 Aug 24 05:53:17.366622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 415/840] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:17 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:53:17.371991 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-34ea81ee-984c-4575-b363-5d74b7acd9d9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '.version_select at 0x7f065c0dedc0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:17.463046 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-34ea81ee-984c-4575-b363-5d74b7acd9d9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482383248" status: 204 len: 0 microversion: 2.20 time: 0.095263 Aug 24 05:53:17.463699 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 416/841] 10.222.0.15 () {60 vars in 1262 bytes} [Wed Aug 24 05:53:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482383248 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:53:17.579370 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f47bf6f0-0aa9-4ee2-8154-0df6fc9359ea tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:17.589478 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f47bf6f0-0aa9-4ee2-8154-0df6fc9359ea tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.662452 Aug 24 05:53:17.590640 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 426/842] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:16 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:18.007498 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-99787077-76cb-499c-b383-293e44614b35 req-133ac3b4-b3fe-4c74-a4dd-a24cdf7e0fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be90cc32-6bea-4a9f-99b6-c47cdbeea246", "tag": "5aeffe0a-e1d3-441b-86b9-7b72a10a2baa"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:18.018484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-99787077-76cb-499c-b383-293e44614b35 req-133ac3b4-b3fe-4c74-a4dd-a24cdf7e0fe9 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:18.018961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-99787077-76cb-499c-b383-293e44614b35 req-133ac3b4-b3fe-4c74-a4dd-a24cdf7e0fe9 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:18.019389 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-99787077-76cb-499c-b383-293e44614b35 req-133ac3b4-b3fe-4c74-a4dd-a24cdf7e0fe9 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:18.030108 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-99787077-76cb-499c-b383-293e44614b35 req-133ac3b4-b3fe-4c74-a4dd-a24cdf7e0fe9 service nova] Creating event network-changed:5aeffe0a-e1d3-441b-86b9-7b72a10a2baa for instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 on hv-cinder-85426 Aug 24 05:53:18.035459 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-99787077-76cb-499c-b383-293e44614b35 req-133ac3b4-b3fe-4c74-a4dd-a24cdf7e0fe9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031716 Aug 24 05:53:18.036050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 417/843] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:18.309646 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1c7581d8-f169-4bf2-b8e3-e5120efabb97 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Action: 'create', calling method: .version_select at 0x7f064ffb94c0>, body: {"keypair": {"name": "tempest-keypair-508786196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFg6tY+QFX8KaGDq0ooIa2qAkTNEnUw2K0zWYbpS6h9FsQIXA+hXpZ+RxGru+0CyMhmEMy3BemPAsuqPFkT0I1OqFHX7KK5LlpiSK9xnc7QMBEB7lLP8aYJdcg25knwhA=="}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:18.319934 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:18.325975 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-1c7581d8-f169-4bf2-b8e3-e5120efabb97 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Getting quotas for project 56fbd96812654d16bbcf3522574a67eb. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:53:18.329779 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-1c7581d8-f169-4bf2-b8e3-e5120efabb97 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Getting quotas for user c7ef3bf8dfd342f5a2fef02bf597af90 and project 56fbd96812654d16bbcf3522574a67eb. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:53:18.432342 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1c7581d8-f169-4bf2-b8e3-e5120efabb97 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.126583 Aug 24 05:53:18.433122 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 427/844] 10.222.0.15 () {62 vars in 1200 bytes} [Wed Aug 24 05:53:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 05:53:18.514883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c09bf809-9d93-401e-853d-22ea1698d4b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:18.515467 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c09bf809-9d93-401e-853d-22ea1698d4b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:18.521793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c09bf809-9d93-401e-853d-22ea1698d4b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:18.522286 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c09bf809-9d93-401e-853d-22ea1698d4b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:18.522719 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c09bf809-9d93-401e-853d-22ea1698d4b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:18.523410 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c09bf809-9d93-401e-853d-22ea1698d4b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:18.523861 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c09bf809-9d93-401e-853d-22ea1698d4b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:18.524879 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c09bf809-9d93-401e-853d-22ea1698d4b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:18.612199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-dcd52c94-e5a3-4d6b-9f5d-cf2193a80450 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:18.613899 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-dcd52c94-e5a3-4d6b-9f5d-cf2193a80450 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:18.620161 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-c09bf809-9d93-401e-853d-22ea1698d4b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lazy-loading 'services' on Instance uuid be90cc32-6bea-4a9f-99b6-c47cdbeea246 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:18.628083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd52c94-e5a3-4d6b-9f5d-cf2193a80450 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:18.629121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd52c94-e5a3-4d6b-9f5d-cf2193a80450 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:18.629819 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd52c94-e5a3-4d6b-9f5d-cf2193a80450 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:18.631116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd52c94-e5a3-4d6b-9f5d-cf2193a80450 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:18.632023 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd52c94-e5a3-4d6b-9f5d-cf2193a80450 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:18.633070 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd52c94-e5a3-4d6b-9f5d-cf2193a80450 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:19.050587 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c09bf809-9d93-401e-853d-22ea1698d4b0 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "DELETE /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments/862ec37c-9893-4185-85a7-36edc61685f3" status: 202 len: 0 microversion: 2.1 time: 0.541220 Aug 24 05:53:19.060371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 418/845] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 05:53:18 2022] DELETE /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments/862ec37c-9893-4185-85a7-36edc61685f3 => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:53:19.062051 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8a507837-cf29-412e-ba33-256b5eb70d80 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:19.064734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8a507837-cf29-412e-ba33-256b5eb70d80 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:19.075445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a507837-cf29-412e-ba33-256b5eb70d80 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:19.076234 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a507837-cf29-412e-ba33-256b5eb70d80 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:19.077111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a507837-cf29-412e-ba33-256b5eb70d80 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:19.078138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a507837-cf29-412e-ba33-256b5eb70d80 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:19.078288 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a507837-cf29-412e-ba33-256b5eb70d80 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:19.078934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8a507837-cf29-412e-ba33-256b5eb70d80 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:19.103112 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dcd52c94-e5a3-4d6b-9f5d-cf2193a80450 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:19.114348 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8a507837-cf29-412e-ba33-256b5eb70d80 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056890 Aug 24 05:53:19.115953 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 419/846] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:53:19 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:19.121295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-dcd52c94-e5a3-4d6b-9f5d-cf2193a80450 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.513136 Aug 24 05:53:19.122567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 428/847] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:18 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:20.055876 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-5c13eeda-99a1-4186-8652-7bcba4819578 req-d1809f9d-944e-40cf-8a6a-0b2bce48801c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be90cc32-6bea-4a9f-99b6-c47cdbeea246", "tag": "5aeffe0a-e1d3-441b-86b9-7b72a10a2baa"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:20.068187 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5c13eeda-99a1-4186-8652-7bcba4819578 req-d1809f9d-944e-40cf-8a6a-0b2bce48801c service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:20.068879 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5c13eeda-99a1-4186-8652-7bcba4819578 req-d1809f9d-944e-40cf-8a6a-0b2bce48801c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:20.069640 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5c13eeda-99a1-4186-8652-7bcba4819578 req-d1809f9d-944e-40cf-8a6a-0b2bce48801c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:20.082397 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-5c13eeda-99a1-4186-8652-7bcba4819578 req-d1809f9d-944e-40cf-8a6a-0b2bce48801c service nova] Creating event network-changed:5aeffe0a-e1d3-441b-86b9-7b72a10a2baa for instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 on hv-cinder-85426 Aug 24 05:53:20.087984 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-5c13eeda-99a1-4186-8652-7bcba4819578 req-d1809f9d-944e-40cf-8a6a-0b2bce48801c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039639 Aug 24 05:53:20.089126 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 420/848] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:20.128274 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6935942b-e871-43a7-a427-c24bc961c09d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:20.130643 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6935942b-e871-43a7-a427-c24bc961c09d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:20.137335 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6935942b-e871-43a7-a427-c24bc961c09d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:20.137829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6935942b-e871-43a7-a427-c24bc961c09d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:20.138519 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6935942b-e871-43a7-a427-c24bc961c09d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:20.139234 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6935942b-e871-43a7-a427-c24bc961c09d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:20.139690 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6935942b-e871-43a7-a427-c24bc961c09d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:20.140294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6935942b-e871-43a7-a427-c24bc961c09d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:20.143935 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f3815783-7000-497d-b7cb-ac0593eb35fc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:20.144781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f3815783-7000-497d-b7cb-ac0593eb35fc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:20.163681 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3815783-7000-497d-b7cb-ac0593eb35fc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:20.164298 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3815783-7000-497d-b7cb-ac0593eb35fc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:20.164842 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3815783-7000-497d-b7cb-ac0593eb35fc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:20.165640 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3815783-7000-497d-b7cb-ac0593eb35fc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:20.166177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3815783-7000-497d-b7cb-ac0593eb35fc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:20.166688 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3815783-7000-497d-b7cb-ac0593eb35fc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:20.174590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6935942b-e871-43a7-a427-c24bc961c09d tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051270 Aug 24 05:53:20.175446 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 429/849] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:53:20 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:20.364956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9c5cd9d1-aaae-4971-902c-18a3d77b1a61 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:20.371585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9c5cd9d1-aaae-4971-902c-18a3d77b1a61 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:20.372468 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c5cd9d1-aaae-4971-902c-18a3d77b1a61 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:20.373255 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c5cd9d1-aaae-4971-902c-18a3d77b1a61 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:20.373927 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c5cd9d1-aaae-4971-902c-18a3d77b1a61 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:20.375629 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c5cd9d1-aaae-4971-902c-18a3d77b1a61 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:20.376417 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c5cd9d1-aaae-4971-902c-18a3d77b1a61 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:20.377068 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9c5cd9d1-aaae-4971-902c-18a3d77b1a61 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:20.400530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f3815783-7000-497d-b7cb-ac0593eb35fc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:20.408994 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f3815783-7000-497d-b7cb-ac0593eb35fc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.269450 Aug 24 05:53:20.411951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9c5cd9d1-aaae-4971-902c-18a3d77b1a61 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Going to try to terminate instance {{(pid=127756) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:53:20.422553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 421/850] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:20 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:20.434447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:20.813901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9c5cd9d1-aaae-4971-902c-18a3d77b1a61 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 204 len: 0 microversion: 2.1 time: 0.453863 Aug 24 05:53:20.814415 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 430/851] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:53:20 2022] DELETE /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:53:20.823106 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4b22eb13-7f64-44c5-9bfd-fa5d73f15e6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:20.823735 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4b22eb13-7f64-44c5-9bfd-fa5d73f15e6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:20.829806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b22eb13-7f64-44c5-9bfd-fa5d73f15e6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:20.830299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b22eb13-7f64-44c5-9bfd-fa5d73f15e6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:20.830744 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b22eb13-7f64-44c5-9bfd-fa5d73f15e6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:20.831444 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b22eb13-7f64-44c5-9bfd-fa5d73f15e6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:20.831913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b22eb13-7f64-44c5-9bfd-fa5d73f15e6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:20.832340 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b22eb13-7f64-44c5-9bfd-fa5d73f15e6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:20.976010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4b22eb13-7f64-44c5-9bfd-fa5d73f15e6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:20.984072 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4b22eb13-7f64-44c5-9bfd-fa5d73f15e6e tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1508 microversion: 2.1 time: 0.164814 Aug 24 05:53:20.984677 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 422/852] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:20 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:21.188373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8f522651-8411-4484-b8be-d2ac08dd0c67 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:21.191489 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8f522651-8411-4484-b8be-d2ac08dd0c67 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:21.198821 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f522651-8411-4484-b8be-d2ac08dd0c67 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:21.199387 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f522651-8411-4484-b8be-d2ac08dd0c67 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:21.199862 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f522651-8411-4484-b8be-d2ac08dd0c67 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:21.200600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f522651-8411-4484-b8be-d2ac08dd0c67 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:21.201061 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f522651-8411-4484-b8be-d2ac08dd0c67 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:21.201487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f522651-8411-4484-b8be-d2ac08dd0c67 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:21.232610 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8f522651-8411-4484-b8be-d2ac08dd0c67 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049010 Aug 24 05:53:21.233182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 431/853] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:53:21 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:53:21.243718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:21.245217 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:21.250946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:21.251438 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:21.251864 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:21.252609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:21.253134 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:21.253561 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:21.337989 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] HTTP exception thrown: Instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 is not attached to volume 862ec37c-9893-4185-85a7-36edc61685f3 Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Request method failure captured: Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: DELETE /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments/862ec37c-9893-4185-85a7-36edc61685f3 HTTP/1.1 Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbtnihRba-UxmkCFBaMIJLUcikqUeFLs5iPxDFZaAbi9P5xkgDo1_Qpp_yVZj2-hoNK_FVpuerofIbt-R9hRxp0ScGr6iPdK6vrkSWshvCCg5I5rPEqPytJbtSvzyKTOMG2DRhkdYK8Lr1J7oKlK3IuYtv1W8TalrpmBTm5Fdp9VNKU Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: de8b104cdda04729a55a5af9d4503c81 Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-TestMinimumBasicScenario-1695525759 Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:53:21.343470 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:53:21.346393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_de8b104cdda04729a55a5af9d4503c81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de8b104cdda04729a55a5af9d4503c81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/de8b104cdda04729a55a5af9d4503c81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de8b104cdda04729a55a5af9d4503c81"}]}] Aug 24 05:53:21.346393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-TestMinimumBasicScenario-1695525759 Aug 24 05:53:21.346393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: de8b104cdda04729a55a5af9d4503c81 Aug 24 05:53:21.346393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1695525759 Aug 24 05:53:21.346393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-TestMinimumBasicScenario-1695525759-project Aug 24 05:53:21.346393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:53:21.346393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:53:21.346393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: 358428458beb4ad6820c6d40d39390e4 Aug 24 05:53:21.346393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-TestMinimumBasicScenario-1695525759-project Aug 24 05:53:21.346393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:53:21.346393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 is not attached to volume 862ec37c-9893-4185-85a7-36edc61685f3 Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'server_id': 'be90cc32-6bea-4a9f-99b6-c47cdbeea246', 'id': '862ec37c-9893-4185-85a7-36edc61685f3'} Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 862ec37c-9893-4185-85a7-36edc61685f3. Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:21.348093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 is not attached to volume 862ec37c-9893-4185-85a7-36edc61685f3 Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 is not attached to volume 862ec37c-9893-4185-85a7-36edc61685f3 Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:21.352621 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Returning 404 to user: Instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 is not attached to volume 862ec37c-9893-4185-85a7-36edc61685f3 {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:21.354035 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b1bc8ec8-8403-464b-9d6e-e1759883f843 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "DELETE /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments/862ec37c-9893-4185-85a7-36edc61685f3" status: 404 len: 154 microversion: 2.1 time: 0.105415 Aug 24 05:53:21.354035 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 423/854] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 05:53:21 2022] DELETE /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246/os-volume_attachments/862ec37c-9893-4185-85a7-36edc61685f3 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:21.361718 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1942789539", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c683523e-e908-47ba-b69c-3344c60dbfc8"}], "security_groups": [{"name": "tempest-securitygroup--1601206137"}], "key_name": "tempest-keypair-508786196", "user_data": "}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:21.429145 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4fbe0d46-064e-4794-b8fa-59bcbd95ba8d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:21.429852 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4fbe0d46-064e-4794-b8fa-59bcbd95ba8d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:21.435902 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fbe0d46-064e-4794-b8fa-59bcbd95ba8d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:21.436385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fbe0d46-064e-4794-b8fa-59bcbd95ba8d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:21.436855 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fbe0d46-064e-4794-b8fa-59bcbd95ba8d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:21.437551 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fbe0d46-064e-4794-b8fa-59bcbd95ba8d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:21.438370 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fbe0d46-064e-4794-b8fa-59bcbd95ba8d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:21.438820 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4fbe0d46-064e-4794-b8fa-59bcbd95ba8d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:21.470825 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.network.neutron [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] validate_networks() for [('c683523e-e908-47ba-b69c-3344c60dbfc8', None, None, None, None, None)] {{(pid=127756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:53:21.745994 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4fbe0d46-064e-4794-b8fa-59bcbd95ba8d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:21.753871 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4fbe0d46-064e-4794-b8fa-59bcbd95ba8d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.328721 Aug 24 05:53:21.754516 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 424/855] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:21 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:22.009413 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f1d63c1d-2331-4fe5-80f4-62cac07215eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:22.009413 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f1d63c1d-2331-4fe5-80f4-62cac07215eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:22.013291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1d63c1d-2331-4fe5-80f4-62cac07215eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.013908 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1d63c1d-2331-4fe5-80f4-62cac07215eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.014593 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1d63c1d-2331-4fe5-80f4-62cac07215eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:22.015370 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1d63c1d-2331-4fe5-80f4-62cac07215eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.015901 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1d63c1d-2331-4fe5-80f4-62cac07215eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.016442 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1d63c1d-2331-4fe5-80f4-62cac07215eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:22.261682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Flavor limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:53:22.262747 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Image limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:53:22.263311 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Flavor pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:53:22.263795 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Image pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:53:22.264499 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:53:22.276056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.277001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.277722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:22.278662 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.279337 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.280985 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:22.301036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f1d63c1d-2331-4fe5-80f4-62cac07215eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:22.301806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Getting quotas for project 56fbd96812654d16bbcf3522574a67eb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:53:22.307750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Getting quotas for user c7ef3bf8dfd342f5a2fef02bf597af90 and project 56fbd96812654d16bbcf3522574a67eb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:53:22.311115 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f1d63c1d-2331-4fe5-80f4-62cac07215eb tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1508 microversion: 2.1 time: 0.309959 Aug 24 05:53:22.325605 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 425/856] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:21 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:22.329630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Going to run 1 instances... {{(pid=127756) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:53:22.330691 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-8eed96c4-c0bb-464d-9659-77800c3b2d07 req-ad4b2cab-21e7-4446-bf05-51085a2c4216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4809e1f-dcaa-4f5b-833e-5a2490d48732", "name": "network-vif-plugged", "status": "completed", "tag": "75dbb744-8992-4d1d-8115-b6514fa8aabd"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:22.332216 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:53:22.340291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-8eed96c4-c0bb-464d-9659-77800c3b2d07 req-ad4b2cab-21e7-4446-bf05-51085a2c4216 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.340798 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-8eed96c4-c0bb-464d-9659-77800c3b2d07 req-ad4b2cab-21e7-4446-bf05-51085a2c4216 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.341233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-8eed96c4-c0bb-464d-9659-77800c3b2d07 req-ad4b2cab-21e7-4446-bf05-51085a2c4216 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:22.352947 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-8eed96c4-c0bb-464d-9659-77800c3b2d07 req-ad4b2cab-21e7-4446-bf05-51085a2c4216 service nova] Creating event network-vif-plugged:75dbb744-8992-4d1d-8115-b6514fa8aabd for instance e4809e1f-dcaa-4f5b-833e-5a2490d48732 on hv-cinder-85426 Aug 24 05:53:22.357763 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-8eed96c4-c0bb-464d-9659-77800c3b2d07 req-ad4b2cab-21e7-4446-bf05-51085a2c4216 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030927 Aug 24 05:53:22.358354 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 426/857] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:22.463905 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-112b2bd6-26df-437d-a60f-4eb12f589d9b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.107283 Aug 24 05:53:22.477848 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-26c80553-9d7d-4311-97d5-baffbe27a8c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:22.479523 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-26c80553-9d7d-4311-97d5-baffbe27a8c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:22.483046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 432/858] 10.222.0.15 () {62 vars in 1188 bytes} [Wed Aug 24 05:53:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 05:53:22.540944 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-b7e4fb24-4f02-4e87-8d4e-ea0033b17830 req-7f195c26-6bc0-4d44-a4f5-a48670f62191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e", "name": "network-vif-deleted", "tag": "ac54fa94-5136-4f4f-9757-f1ec362eb68d"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:22.556353 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b7e4fb24-4f02-4e87-8d4e-ea0033b17830 req-7f195c26-6bc0-4d44-a4f5-a48670f62191 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.556896 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b7e4fb24-4f02-4e87-8d4e-ea0033b17830 req-7f195c26-6bc0-4d44-a4f5-a48670f62191 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.557333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b7e4fb24-4f02-4e87-8d4e-ea0033b17830 req-7f195c26-6bc0-4d44-a4f5-a48670f62191 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:22.572895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-b7e4fb24-4f02-4e87-8d4e-ea0033b17830 req-7f195c26-6bc0-4d44-a4f5-a48670f62191 service nova] Creating event network-vif-deleted:ac54fa94-5136-4f4f-9757-f1ec362eb68d for instance c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e on hv-cinder-85426 Aug 24 05:53:22.581125 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-b7e4fb24-4f02-4e87-8d4e-ea0033b17830 req-7f195c26-6bc0-4d44-a4f5-a48670f62191 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048670 Aug 24 05:53:22.583584 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 433/859] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:22.597358 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-26c80553-9d7d-4311-97d5-baffbe27a8c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:22.615283 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-26c80553-9d7d-4311-97d5-baffbe27a8c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:22.620720 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-26c80553-9d7d-4311-97d5-baffbe27a8c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:22.624136 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-26c80553-9d7d-4311-97d5-baffbe27a8c8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1281 microversion: 2.20 time: 0.151884 Aug 24 05:53:22.625260 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 427/860] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:22 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:53:22.648964 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-04b8062a-c3a1-4a7a-82e3-95c171c5fc58 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:22.649629 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-04b8062a-c3a1-4a7a-82e3-95c171c5fc58 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:22.656189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04b8062a-c3a1-4a7a-82e3-95c171c5fc58 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.660887 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04b8062a-c3a1-4a7a-82e3-95c171c5fc58 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.661820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04b8062a-c3a1-4a7a-82e3-95c171c5fc58 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:22.672722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04b8062a-c3a1-4a7a-82e3-95c171c5fc58 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.672722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04b8062a-c3a1-4a7a-82e3-95c171c5fc58 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.672722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-04b8062a-c3a1-4a7a-82e3-95c171c5fc58 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:22.693759 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-04b8062a-c3a1-4a7a-82e3-95c171c5fc58 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Going to try to terminate instance {{(pid=127756) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:53:22.775880 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2887308d-b3e9-457e-92ee-35d9da7694c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:22.776457 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2887308d-b3e9-457e-92ee-35d9da7694c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:22.783293 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2887308d-b3e9-457e-92ee-35d9da7694c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.789465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2887308d-b3e9-457e-92ee-35d9da7694c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.789465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2887308d-b3e9-457e-92ee-35d9da7694c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:22.789465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2887308d-b3e9-457e-92ee-35d9da7694c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.789465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2887308d-b3e9-457e-92ee-35d9da7694c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.789953 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2887308d-b3e9-457e-92ee-35d9da7694c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:22.975962 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2887308d-b3e9-457e-92ee-35d9da7694c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:22.984245 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2887308d-b3e9-457e-92ee-35d9da7694c5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.212321 Aug 24 05:53:22.984874 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 428/861] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:22 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:23.066338 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-04b8062a-c3a1-4a7a-82e3-95c171c5fc58 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "DELETE /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 204 len: 0 microversion: 2.1 time: 0.422351 Aug 24 05:53:23.066945 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 434/862] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:53:22 2022] DELETE /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:53:23.075813 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b028960d-000c-40d2-b142-58dd6a9ab1eb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:23.076530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b028960d-000c-40d2-b142-58dd6a9ab1eb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:23.082666 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b028960d-000c-40d2-b142-58dd6a9ab1eb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:23.083091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b028960d-000c-40d2-b142-58dd6a9ab1eb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:23.084252 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b028960d-000c-40d2-b142-58dd6a9ab1eb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:23.084806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b028960d-000c-40d2-b142-58dd6a9ab1eb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:23.085264 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b028960d-000c-40d2-b142-58dd6a9ab1eb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:23.085690 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b028960d-000c-40d2-b142-58dd6a9ab1eb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:23.218153 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b028960d-000c-40d2-b142-58dd6a9ab1eb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:23.221761 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:23.226263 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b028960d-000c-40d2-b142-58dd6a9ab1eb tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1552 microversion: 2.1 time: 0.154532 Aug 24 05:53:23.226831 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 429/863] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:23 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:23.336917 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:23.337562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:23.344028 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:23.344544 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:23.344983 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:23.345670 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:23.346160 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:23.346587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:23.378916 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:23.379397 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:23.379860 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:23.381215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lazy-loading 'fault' on Instance uuid c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:23.425869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:23.434864 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-430d49a6-feeb-4057-8115-217827ea7a06 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1312 microversion: 2.1 time: 0.102957 Aug 24 05:53:23.435426 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 435/864] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:23 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:23.647297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:23.647882 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:23.654272 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:23.654749 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:23.655184 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:23.655866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:23.656317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:23.656772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:23.720883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:23.728996 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:23.730503 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:23.731597 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4aec1e00-6f1c-4766-be26-0aeb1f4b41cd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1285 microversion: 2.20 time: 0.089049 Aug 24 05:53:23.732144 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 430/865] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:23 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:24.009651 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-206159ec-60f6-4548-a108-e1a457aaa482 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:24.010180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-206159ec-60f6-4548-a108-e1a457aaa482 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:24.016270 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-206159ec-60f6-4548-a108-e1a457aaa482 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:24.016787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-206159ec-60f6-4548-a108-e1a457aaa482 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:24.017223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-206159ec-60f6-4548-a108-e1a457aaa482 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:24.017906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-206159ec-60f6-4548-a108-e1a457aaa482 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:24.018359 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-206159ec-60f6-4548-a108-e1a457aaa482 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:24.018782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-206159ec-60f6-4548-a108-e1a457aaa482 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:24.149440 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-206159ec-60f6-4548-a108-e1a457aaa482 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:24.157002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-206159ec-60f6-4548-a108-e1a457aaa482 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.151457 Aug 24 05:53:24.157559 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 436/866] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:24 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:24.247011 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6289f867-a5e6-41bf-a4b7-d6aebc005abd tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:24.247617 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6289f867-a5e6-41bf-a4b7-d6aebc005abd tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:24.253613 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6289f867-a5e6-41bf-a4b7-d6aebc005abd tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:24.254086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6289f867-a5e6-41bf-a4b7-d6aebc005abd tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:24.254517 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6289f867-a5e6-41bf-a4b7-d6aebc005abd tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:24.255194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6289f867-a5e6-41bf-a4b7-d6aebc005abd tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:24.255643 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6289f867-a5e6-41bf-a4b7-d6aebc005abd tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:24.256062 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6289f867-a5e6-41bf-a4b7-d6aebc005abd tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:24.385259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6289f867-a5e6-41bf-a4b7-d6aebc005abd tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:24.392875 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6289f867-a5e6-41bf-a4b7-d6aebc005abd tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1552 microversion: 2.1 time: 0.149678 Aug 24 05:53:24.393437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 431/867] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:24 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:24.456153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:24.456796 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:24.464266 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:24.464787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:24.465233 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:24.465926 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:24.466387 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:24.466817 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:24.498923 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:24.499407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:24.499850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:24.500296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lazy-loading 'fault' on Instance uuid c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:24.541954 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:24.549749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bf275106-181b-4982-852a-bd72281337d2 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1312 microversion: 2.1 time: 0.097487 Aug 24 05:53:24.550308 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 437/868] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:24 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:24.754437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:24.755033 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:24.762666 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:24.763148 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:24.763852 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:24.764583 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:24.765041 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:24.765464 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:24.828418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:24.837980 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:24.839533 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:24.840684 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-853abb73-ba9b-4f16-a5ef-ffce7387eb98 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1285 microversion: 2.20 time: 0.090132 Aug 24 05:53:24.841254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 432/869] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:24 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:25.178563 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f1631ac3-a71f-4a1a-b6e8-62d88a310b17 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:25.179173 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f1631ac3-a71f-4a1a-b6e8-62d88a310b17 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:25.185647 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1631ac3-a71f-4a1a-b6e8-62d88a310b17 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:25.186142 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1631ac3-a71f-4a1a-b6e8-62d88a310b17 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:25.186582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1631ac3-a71f-4a1a-b6e8-62d88a310b17 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:25.187450 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1631ac3-a71f-4a1a-b6e8-62d88a310b17 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:25.187727 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1631ac3-a71f-4a1a-b6e8-62d88a310b17 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:25.188155 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1631ac3-a71f-4a1a-b6e8-62d88a310b17 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:25.319526 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f1631ac3-a71f-4a1a-b6e8-62d88a310b17 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:25.327309 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f1631ac3-a71f-4a1a-b6e8-62d88a310b17 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.153168 Aug 24 05:53:25.327870 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 438/870] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:25 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:25.414320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3820f808-d558-43ab-bd1f-dfab48b8f761 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:25.415534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3820f808-d558-43ab-bd1f-dfab48b8f761 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:25.421602 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3820f808-d558-43ab-bd1f-dfab48b8f761 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:25.422344 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3820f808-d558-43ab-bd1f-dfab48b8f761 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:25.422777 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3820f808-d558-43ab-bd1f-dfab48b8f761 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:25.423485 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3820f808-d558-43ab-bd1f-dfab48b8f761 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:25.423936 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3820f808-d558-43ab-bd1f-dfab48b8f761 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:25.424353 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3820f808-d558-43ab-bd1f-dfab48b8f761 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:25.554151 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3820f808-d558-43ab-bd1f-dfab48b8f761 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:25.561797 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3820f808-d558-43ab-bd1f-dfab48b8f761 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1552 microversion: 2.1 time: 0.151382 Aug 24 05:53:25.562364 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 433/871] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:25 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:25.571590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:25.572223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:25.578884 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:25.579364 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:25.579794 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:25.580509 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:25.580960 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:25.581413 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:25.611917 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:25.612423 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:25.612859 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:25.613299 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lazy-loading 'fault' on Instance uuid c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:25.656017 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:25.664223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ba0f98ba-95c9-46d9-aaee-5ff98b8a28ff tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 200 len: 1312 microversion: 2.1 time: 0.097287 Aug 24 05:53:25.664812 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 439/872] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:25 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:25.863571 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:25.864539 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:25.872297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:25.872900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:25.873633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:25.874398 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:25.875070 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:25.875681 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:25.950477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:25.960062 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:25.961649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:25.962762 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7186276c-f963-4af9-89d5-5771e1f9a840 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1285 microversion: 2.20 time: 0.103535 Aug 24 05:53:25.963352 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 434/873] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:25 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:26.347424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-35fc8a06-e9ba-425f-909e-fcffd592e30e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:26.347965 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-35fc8a06-e9ba-425f-909e-fcffd592e30e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:26.353966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35fc8a06-e9ba-425f-909e-fcffd592e30e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.354445 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35fc8a06-e9ba-425f-909e-fcffd592e30e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.354874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35fc8a06-e9ba-425f-909e-fcffd592e30e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.355553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35fc8a06-e9ba-425f-909e-fcffd592e30e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.356002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35fc8a06-e9ba-425f-909e-fcffd592e30e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.356439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-35fc8a06-e9ba-425f-909e-fcffd592e30e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.546266 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-abd2547b-c5d7-4274-a964-e54673afe0ea req-44d67e65-7db9-4810-ad8d-9ab8d6fd41f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be90cc32-6bea-4a9f-99b6-c47cdbeea246", "name": "network-vif-deleted", "tag": "5aeffe0a-e1d3-441b-86b9-7b72a10a2baa"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:26.556634 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-abd2547b-c5d7-4274-a964-e54673afe0ea req-44d67e65-7db9-4810-ad8d-9ab8d6fd41f3 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.557121 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-abd2547b-c5d7-4274-a964-e54673afe0ea req-44d67e65-7db9-4810-ad8d-9ab8d6fd41f3 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.557563 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-abd2547b-c5d7-4274-a964-e54673afe0ea req-44d67e65-7db9-4810-ad8d-9ab8d6fd41f3 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.568854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-35fc8a06-e9ba-425f-909e-fcffd592e30e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:26.569059 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-abd2547b-c5d7-4274-a964-e54673afe0ea req-44d67e65-7db9-4810-ad8d-9ab8d6fd41f3 service nova] Creating event network-vif-deleted:5aeffe0a-e1d3-441b-86b9-7b72a10a2baa for instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 on hv-cinder-85426 Aug 24 05:53:26.574148 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-abd2547b-c5d7-4274-a964-e54673afe0ea req-44d67e65-7db9-4810-ad8d-9ab8d6fd41f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031775 Aug 24 05:53:26.574750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 435/874] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:53:26.578012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-35fc8a06-e9ba-425f-909e-fcffd592e30e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1265 microversion: 2.1 time: 0.233973 Aug 24 05:53:26.578584 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 440/875] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:26 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:26.582164 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-eab98dec-769e-40c9-a2d9-4a1761a873c3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:26.584288 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-eab98dec-769e-40c9-a2d9-4a1761a873c3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:26.587574 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:26.591239 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eab98dec-769e-40c9-a2d9-4a1761a873c3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.591733 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eab98dec-769e-40c9-a2d9-4a1761a873c3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.592173 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eab98dec-769e-40c9-a2d9-4a1761a873c3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.593023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eab98dec-769e-40c9-a2d9-4a1761a873c3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.593505 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eab98dec-769e-40c9-a2d9-4a1761a873c3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.593916 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-eab98dec-769e-40c9-a2d9-4a1761a873c3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.660490 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-eab98dec-769e-40c9-a2d9-4a1761a873c3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:26.669609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-eab98dec-769e-40c9-a2d9-4a1761a873c3 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1510 microversion: 2.1 time: 0.091465 Aug 24 05:53:26.670187 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 436/876] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:26 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1510 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:26.684656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:26.685268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:26.691296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.691782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.692224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.693010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.693507 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.693931 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.712275 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] HTTP exception thrown: Instance c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e could not be found. Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Request method failure captured: Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e HTTP/1.1 Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrJzcprHqQlE5leVvGfV6xgwH1tOW0OIj8bhIII0tPRpVgD4vrhN0TkXcTjl15pHeEFXnr9AQBXPxDdB2BYsR5TOA76YGfCuwpJD9i-Sssl_bP9CSaMttD_juz07C2hdpqvtLcP6hER3DOwih0w66MhihvnUtIVn_DOGnwbrS6REzc Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 39a99050c88d48db851f437f68b65a58 Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:53:26.714031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_39a99050c88d48db851f437f68b65a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a99050c88d48db851f437f68b65a58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/39a99050c88d48db851f437f68b65a58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a99050c88d48db851f437f68b65a58"}]}] Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 39a99050c88d48db851f437f68b65a58 Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-ServerRescueNegativeTestJSON-1927483895-project Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 926115c2e54741e6a3aca02437309b8f Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1927483895-project Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e could not be found. Aug 24 05:53:26.715613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': 'c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e'} Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e could not be found. Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:26.716738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e could not be found. Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e could not be found. Aug 24 05:53:26.718215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:26.719650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Returning 404 to user: Instance c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:26.719650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-56619651-62ab-457a-ae0b-005e0605db83 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e" status: 404 len: 111 microversion: 2.1 time: 0.035067 Aug 24 05:53:26.719650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 441/877] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:26 2022] GET /compute/v2.1/servers/c87f7fd4-7c3a-4744-a8d0-a81c18b79c9e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:26.726246 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1ea77a02-8d5d-40a9-86dd-4a9edb0a38f8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:26.726762 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1ea77a02-8d5d-40a9-86dd-4a9edb0a38f8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:26.733343 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ea77a02-8d5d-40a9-86dd-4a9edb0a38f8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.733899 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ea77a02-8d5d-40a9-86dd-4a9edb0a38f8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.734274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ea77a02-8d5d-40a9-86dd-4a9edb0a38f8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.735001 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ea77a02-8d5d-40a9-86dd-4a9edb0a38f8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.735498 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ea77a02-8d5d-40a9-86dd-4a9edb0a38f8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.735930 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ea77a02-8d5d-40a9-86dd-4a9edb0a38f8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.764093 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1ea77a02-8d5d-40a9-86dd-4a9edb0a38f8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:53:26.985832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:26.986913 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:26.994390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.994881 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.995319 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.996019 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.997542 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.998538 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.089639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:27.098087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:27.100313 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:27.101458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6422887e-901e-416f-b465-cc7ee5cb59d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1333 microversion: 2.20 time: 0.119644 Aug 24 05:53:27.102013 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 442/878] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:26 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1333 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:53:27.119177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1ea77a02-8d5d-40a9-86dd-4a9edb0a38f8 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "DELETE /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 204 len: 0 microversion: 2.1 time: 0.398299 Aug 24 05:53:27.120127 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 437/879] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:53:26 2022] DELETE /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:53:27.132486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b718dfff-3818-4839-ac80-a094e3fb8c00 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:27.135013 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b718dfff-3818-4839-ac80-a094e3fb8c00 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:27.141291 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b718dfff-3818-4839-ac80-a094e3fb8c00 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.141790 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b718dfff-3818-4839-ac80-a094e3fb8c00 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.142247 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b718dfff-3818-4839-ac80-a094e3fb8c00 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.142956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b718dfff-3818-4839-ac80-a094e3fb8c00 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.143416 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b718dfff-3818-4839-ac80-a094e3fb8c00 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.143846 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b718dfff-3818-4839-ac80-a094e3fb8c00 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.277258 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b718dfff-3818-4839-ac80-a094e3fb8c00 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:27.285065 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b718dfff-3818-4839-ac80-a094e3fb8c00 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.158119 Aug 24 05:53:27.285654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 443/880] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:27 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:27.600232 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-92728a59-fe16-4a07-aac4-ff7fa860336a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:27.600979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-92728a59-fe16-4a07-aac4-ff7fa860336a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:27.607027 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92728a59-fe16-4a07-aac4-ff7fa860336a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.607522 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92728a59-fe16-4a07-aac4-ff7fa860336a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.607946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92728a59-fe16-4a07-aac4-ff7fa860336a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.608655 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92728a59-fe16-4a07-aac4-ff7fa860336a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.609105 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92728a59-fe16-4a07-aac4-ff7fa860336a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.609525 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92728a59-fe16-4a07-aac4-ff7fa860336a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.691147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:27.691765 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:27.698787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.699284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.699724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.700449 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.700916 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.701338 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.741313 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.741796 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.742233 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.742684 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lazy-loading 'fault' on Instance uuid be90cc32-6bea-4a9f-99b6-c47cdbeea246 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:27.769764 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-92728a59-fe16-4a07-aac4-ff7fa860336a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:27.798085 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-92728a59-fe16-4a07-aac4-ff7fa860336a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1451 microversion: 2.1 time: 0.195054 Aug 24 05:53:27.798085 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 438/881] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:27 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1451 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:27.798571 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358428458beb4ad6820c6d40d39390e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de8b104cdda04729a55a5af9d4503c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:27.799402 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6f2a5826-4e0f-43e5-8d3f-696475e9de6c tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 200 len: 1347 microversion: 2.1 time: 0.112112 Aug 24 05:53:27.799960 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 444/882] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:27 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 1347 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:27.812339 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-66b431e5-3583-479d-8604-89a6587dca3b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:27.812991 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-66b431e5-3583-479d-8604-89a6587dca3b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:27.819181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66b431e5-3583-479d-8604-89a6587dca3b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.819669 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66b431e5-3583-479d-8604-89a6587dca3b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.820128 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66b431e5-3583-479d-8604-89a6587dca3b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.820856 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66b431e5-3583-479d-8604-89a6587dca3b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.821324 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66b431e5-3583-479d-8604-89a6587dca3b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.821751 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66b431e5-3583-479d-8604-89a6587dca3b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.953520 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-66b431e5-3583-479d-8604-89a6587dca3b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:27.962001 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-66b431e5-3583-479d-8604-89a6587dca3b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1451 microversion: 2.1 time: 0.153531 Aug 24 05:53:27.962560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 439/883] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:27 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:28.136612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:28.141887 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:28.147968 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:28.148504 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:28.148940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:28.149723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:28.150126 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:28.151217 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:28.155693 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:28.308904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-02609e81-16b1-4a78-aa0d-6c13f2d355df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:28.312118 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-02609e81-16b1-4a78-aa0d-6c13f2d355df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:28.319916 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02609e81-16b1-4a78-aa0d-6c13f2d355df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:28.321031 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02609e81-16b1-4a78-aa0d-6c13f2d355df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:28.321550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02609e81-16b1-4a78-aa0d-6c13f2d355df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:28.322578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02609e81-16b1-4a78-aa0d-6c13f2d355df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:28.323773 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02609e81-16b1-4a78-aa0d-6c13f2d355df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:28.324297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-02609e81-16b1-4a78-aa0d-6c13f2d355df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:28.550496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:28.567950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:28.567950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:28.567950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f1a1c93f-8823-4cc8-96a9-fd021cb22752 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1341 microversion: 2.20 time: 0.430676 Aug 24 05:53:28.568380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 445/884] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:28 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1341 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:28.647868 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-02609e81-16b1-4a78-aa0d-6c13f2d355df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:28.656646 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-02609e81-16b1-4a78-aa0d-6c13f2d355df tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1522 microversion: 2.1 time: 0.352652 Aug 24 05:53:28.657433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 440/885] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:28 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:28.826888 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:28.827748 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] [instance: be90cc32-6bea-4a9f-99b6-c47cdbeea246] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:28.835699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:28.836202 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:28.836673 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:28.837397 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:28.837857 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:28.838292 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:28.852987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] HTTP exception thrown: Instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 could not be found. Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Request method failure captured: Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 HTTP/1.1 Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbtnihRba-UxmkCFBaMIJLUcikqUeFLs5iPxDFZaAbi9P5xkgDo1_Qpp_yVZj2-hoNK_FVpuerofIbt-R9hRxp0ScGr6iPdK6vrkSWshvCCg5I5rPEqPytJbtSvzyKTOMG2DRhkdYK8Lr1J7oKlK3IuYtv1W8TalrpmBTm5Fdp9VNKU Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: de8b104cdda04729a55a5af9d4503c81 Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-TestMinimumBasicScenario-1695525759 Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:53:28.854566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_de8b104cdda04729a55a5af9d4503c81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de8b104cdda04729a55a5af9d4503c81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/de8b104cdda04729a55a5af9d4503c81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de8b104cdda04729a55a5af9d4503c81"}]}] Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-TestMinimumBasicScenario-1695525759 Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: de8b104cdda04729a55a5af9d4503c81 Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1695525759 Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-TestMinimumBasicScenario-1695525759-project Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 358428458beb4ad6820c6d40d39390e4 Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-TestMinimumBasicScenario-1695525759-project Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 could not be found. Aug 24 05:53:28.856362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': 'be90cc32-6bea-4a9f-99b6-c47cdbeea246'} Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 could not be found. Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:28.857213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 could not be found. Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 could not be found. Aug 24 05:53:28.858496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:53:28.859633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Returning 404 to user: Instance be90cc32-6bea-4a9f-99b6-c47cdbeea246 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:28.859633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4371a3c4-90dc-4a5c-88ca-9291d9c5567f tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246" status: 404 len: 111 microversion: 2.1 time: 0.038761 Aug 24 05:53:28.859633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 446/886] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:28 2022] GET /compute/v2.1/servers/be90cc32-6bea-4a9f-99b6-c47cdbeea246 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:28.867620 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-64f94250-9e7d-4e2e-8def-d2e3b17debb5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] Calling method '.version_select at 0x7f064fed4940>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:29.010701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-64f94250-9e7d-4e2e-8def-d2e3b17debb5 tempest-TestMinimumBasicScenario-1695525759 tempest-TestMinimumBasicScenario-1695525759-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-107995616" status: 202 len: 0 microversion: 2.1 time: 0.149143 Aug 24 05:53:29.014553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 441/887] 10.222.0.15 () {58 vars in 1269 bytes} [Wed Aug 24 05:53:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-107995616 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:53:29.198904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-b4104fcd-6520-4475-a256-5f91e6dad70b req-f6970b09-588d-445f-a9ad-d0e6cd9f3f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876be02b-9b39-4f01-9650-28904167d60f", "name": "network-vif-deleted", "tag": "43f1d0e1-4b2c-4e2b-95d1-f3ec8ce75535"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:29.216665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b4104fcd-6520-4475-a256-5f91e6dad70b req-f6970b09-588d-445f-a9ad-d0e6cd9f3f6c service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:29.217795 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b4104fcd-6520-4475-a256-5f91e6dad70b req-f6970b09-588d-445f-a9ad-d0e6cd9f3f6c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:29.218308 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b4104fcd-6520-4475-a256-5f91e6dad70b req-f6970b09-588d-445f-a9ad-d0e6cd9f3f6c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:29.233076 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-b4104fcd-6520-4475-a256-5f91e6dad70b req-f6970b09-588d-445f-a9ad-d0e6cd9f3f6c service nova] Creating event network-vif-deleted:43f1d0e1-4b2c-4e2b-95d1-f3ec8ce75535 for instance 876be02b-9b39-4f01-9650-28904167d60f on hv-cinder-85426 Aug 24 05:53:29.239246 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-b4104fcd-6520-4475-a256-5f91e6dad70b req-f6970b09-588d-445f-a9ad-d0e6cd9f3f6c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053180 Aug 24 05:53:29.240455 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 447/888] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:29.586862 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:29.587417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:29.599577 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:29.599806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:29.600179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:29.606454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:29.606454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:29.606454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:29.680625 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:29.682720 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:29.691477 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:29.692718 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:29.693303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:29.694306 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:29.694843 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:29.695380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:29.736174 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:29.736751 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:29.737190 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:29.737646 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lazy-loading 'fault' on Instance uuid 876be02b-9b39-4f01-9650-28904167d60f {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:29.826432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926115c2e54741e6a3aca02437309b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a99050c88d48db851f437f68b65a58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:29.836204 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4aff5e64-4441-41cf-b95a-b70f2af80c82 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 200 len: 1312 microversion: 2.1 time: 0.161084 Aug 24 05:53:29.837112 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 448/889] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:29 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:29.882626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:29.893171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:29.894699 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:29.896641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-26d12b49-406a-40df-9ce1-ad39ab90ec60 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1407 microversion: 2.20 time: 0.313327 Aug 24 05:53:29.897533 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 442/890] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:29 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:30.664560 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-dfafc042-9a6b-4814-bec3-d0f33f3a1bd0 req-980b24d0-bb4e-4537-b7dc-728c1f2ce7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96fde59-06c5-4305-b87a-9fde71a07588", "tag": "d949a0c9-9094-4077-9a1f-391953b800d1"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:30.672953 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-dfafc042-9a6b-4814-bec3-d0f33f3a1bd0 req-980b24d0-bb4e-4537-b7dc-728c1f2ce7f6 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:30.673435 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-dfafc042-9a6b-4814-bec3-d0f33f3a1bd0 req-980b24d0-bb4e-4537-b7dc-728c1f2ce7f6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:30.674077 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-dfafc042-9a6b-4814-bec3-d0f33f3a1bd0 req-980b24d0-bb4e-4537-b7dc-728c1f2ce7f6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:30.686280 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-dfafc042-9a6b-4814-bec3-d0f33f3a1bd0 req-980b24d0-bb4e-4537-b7dc-728c1f2ce7f6 service nova] Creating event network-changed:d949a0c9-9094-4077-9a1f-391953b800d1 for instance a96fde59-06c5-4305-b87a-9fde71a07588 on hv-cinder-85426 Aug 24 05:53:30.691379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-dfafc042-9a6b-4814-bec3-d0f33f3a1bd0 req-980b24d0-bb4e-4537-b7dc-728c1f2ce7f6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032533 Aug 24 05:53:30.693720 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 449/891] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:30.866131 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:30.867656 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] [instance: 876be02b-9b39-4f01-9650-28904167d60f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:30.874774 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:30.875803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:30.876585 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:30.877494 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:30.878138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:30.879347 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] HTTP exception thrown: Instance 876be02b-9b39-4f01-9650-28904167d60f could not be found. Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Request method failure captured: Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f HTTP/1.1 Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbrJzcprHqQlE5leVvGfV6xgwH1tOW0OIj8bhIII0tPRpVgD4vrhN0TkXcTjl15pHeEFXnr9AQBXPxDdB2BYsR5TOA76YGfCuwpJD9i-Sssl_bP9CSaMttD_juz07C2hdpqvtLcP6hER3DOwih0w66MhihvnUtIVn_DOGnwbrS6REzc Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 39a99050c88d48db851f437f68b65a58 Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:53:30.919780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_39a99050c88d48db851f437f68b65a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a99050c88d48db851f437f68b65a58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/39a99050c88d48db851f437f68b65a58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a99050c88d48db851f437f68b65a58"}]}] Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 39a99050c88d48db851f437f68b65a58 Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1927483895 Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-ServerRescueNegativeTestJSON-1927483895-project Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: 926115c2e54741e6a3aca02437309b8f Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1927483895-project Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 876be02b-9b39-4f01-9650-28904167d60f could not be found. Aug 24 05:53:30.921934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '876be02b-9b39-4f01-9650-28904167d60f'} Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 876be02b-9b39-4f01-9650-28904167d60f could not be found. Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:30.923081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 876be02b-9b39-4f01-9650-28904167d60f could not be found. Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 876be02b-9b39-4f01-9650-28904167d60f could not be found. Aug 24 05:53:30.924611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:53:30.926437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] Returning 404 to user: Instance 876be02b-9b39-4f01-9650-28904167d60f could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:30.926518 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:30.926518 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:30.928476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-668e65d4-3a92-4d8f-b1e3-e1facf11ec50 tempest-ServerRescueNegativeTestJSON-1927483895 tempest-ServerRescueNegativeTestJSON-1927483895-project] 10.222.0.15 "GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f" status: 404 len: 111 microversion: 2.1 time: 0.070605 Aug 24 05:53:30.929262 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 443/892] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:30 2022] GET /compute/v2.1/servers/876be02b-9b39-4f01-9650-28904167d60f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:30.936843 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:30.937745 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:30.938470 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:30.939331 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:30.939939 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:30.940645 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:31.259029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-e0ca6e7d-70e6-48cd-9f9d-12b8278134fa req-6c37be70-475f-40d7-a3c9-0ed1bd228b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4809e1f-dcaa-4f5b-833e-5a2490d48732", "tag": "75dbb744-8992-4d1d-8115-b6514fa8aabd"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:31.273455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-e0ca6e7d-70e6-48cd-9f9d-12b8278134fa req-6c37be70-475f-40d7-a3c9-0ed1bd228b7c service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:31.274415 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-e0ca6e7d-70e6-48cd-9f9d-12b8278134fa req-6c37be70-475f-40d7-a3c9-0ed1bd228b7c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:31.275099 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-e0ca6e7d-70e6-48cd-9f9d-12b8278134fa req-6c37be70-475f-40d7-a3c9-0ed1bd228b7c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:31.290721 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-e0ca6e7d-70e6-48cd-9f9d-12b8278134fa req-6c37be70-475f-40d7-a3c9-0ed1bd228b7c service nova] Creating event network-changed:75dbb744-8992-4d1d-8115-b6514fa8aabd for instance e4809e1f-dcaa-4f5b-833e-5a2490d48732 on hv-cinder-85426 Aug 24 05:53:31.302357 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-e0ca6e7d-70e6-48cd-9f9d-12b8278134fa req-6c37be70-475f-40d7-a3c9-0ed1bd228b7c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047707 Aug 24 05:53:31.304192 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 444/893] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:53:31.323915 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:31.338492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:31.341753 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:31.343255 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d4d9f021-ddbe-4125-933c-57a5023dfaec tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1407 microversion: 2.20 time: 0.427631 Aug 24 05:53:31.344599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 450/894] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:30 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1407 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:32.368466 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:32.369773 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:32.376754 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:32.377243 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:32.377682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:32.378388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:32.378849 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:32.379280 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:32.600526 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:32.604620 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:32.612524 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:32.615118 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:32.621029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-73991dfd-897c-4a79-80cd-c3dbe84091c0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1407 microversion: 2.20 time: 0.254756 Aug 24 05:53:32.637227 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 445/895] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:32 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:33.653050 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:33.654297 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:33.661983 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:33.666045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=10 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:33.666045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:33.666045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:33.666045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:33.667334 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:33.667960 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:33.668594 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:34.026490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:34.038069 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:34.039982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:34.041464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-25490913-7a6a-4764-98df-7f1833a758cb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1407 microversion: 2.20 time: 0.397202 Aug 24 05:53:34.043599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 451/896] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:33 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:35.083778 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:35.084582 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:35.091915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:35.092520 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:35.092913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:35.093636 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:35.094098 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:35.094530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:35.459500 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:35.478043 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:35.480486 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:35.481705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-45bc38e1-fecb-43ff-8891-d7e2d45c34f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1407 microversion: 2.20 time: 0.419164 Aug 24 05:53:35.482373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 446/897] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:35 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:36.503952 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:36.505354 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:36.519469 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:36.520965 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:36.521512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:36.522538 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:36.522999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:36.523612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:36.710600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:36.719290 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:36.720868 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:36.721957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f18f37ad-5816-4f65-a108-548bd38a8efe tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1407 microversion: 2.20 time: 0.221874 Aug 24 05:53:36.722553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 452/898] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:36 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:37.745111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:37.745851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:37.752653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:37.753147 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:37.753591 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:37.754437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:37.755463 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:37.756073 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:37.960885 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:37.966151 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:37.972845 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:37.983381 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:37.999754 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6c4ddc16-1233-4ad1-9417-c865e6b669f0 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1407 microversion: 2.20 time: 0.258604 Aug 24 05:53:38.006717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 447/899] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:37 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:38.194616 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-fa2d2a57-be1b-4d46-b972-55f7291308c5 req-68e13f6a-ce4c-483e-9330-a9f2620519a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96fde59-06c5-4305-b87a-9fde71a07588", "name": "network-vif-plugged", "status": "completed", "tag": "d949a0c9-9094-4077-9a1f-391953b800d1"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:38.213012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-fa2d2a57-be1b-4d46-b972-55f7291308c5 req-68e13f6a-ce4c-483e-9330-a9f2620519a3 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:38.213503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-fa2d2a57-be1b-4d46-b972-55f7291308c5 req-68e13f6a-ce4c-483e-9330-a9f2620519a3 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:38.213942 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-fa2d2a57-be1b-4d46-b972-55f7291308c5 req-68e13f6a-ce4c-483e-9330-a9f2620519a3 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:38.249136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-fa2d2a57-be1b-4d46-b972-55f7291308c5 req-68e13f6a-ce4c-483e-9330-a9f2620519a3 service nova] Creating event network-vif-plugged:d949a0c9-9094-4077-9a1f-391953b800d1 for instance a96fde59-06c5-4305-b87a-9fde71a07588 on hv-cinder-85426 Aug 24 05:53:38.259218 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-fa2d2a57-be1b-4d46-b972-55f7291308c5 req-68e13f6a-ce4c-483e-9330-a9f2620519a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070418 Aug 24 05:53:38.259836 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 453/900] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:39.028746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:39.028746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:39.046600 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:39.047416 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:39.048047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:39.048952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:39.049914 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:39.050506 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:39.238958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:39.247883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:39.249479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:39.250836 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c680d561-2fc0-46c7-b1da-a07428a8418f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1407 microversion: 2.20 time: 0.228103 Aug 24 05:53:39.251810 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 448/901] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:39 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:40.275375 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:40.276169 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:40.279893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:40.287668 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:40.289614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:40.290828 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:40.291554 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:40.292225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:40.293740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:40.530021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:40.565569 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:40.581822 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:40.583390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e9ec5065-fc5f-4215-b96f-c8ae8e704d33 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1407 microversion: 2.20 time: 0.313146 Aug 24 05:53:40.587505 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 454/902] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:40 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:41.609639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:41.610203 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:41.617573 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:41.618060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:41.624564 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:41.624564 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:41.624564 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:41.624564 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:42.027408 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:42.038243 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:42.040100 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:42.041964 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4cd3c973-ce6e-46bc-be7d-199a3e0d93e7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1598 microversion: 2.20 time: 0.436192 Aug 24 05:53:42.042534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 449/903] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:41 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1598 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:42.065532 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d99ae942-815f-4761-b22e-a99a7d1fe2c5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:42.066685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d99ae942-815f-4761-b22e-a99a7d1fe2c5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:42.078458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d99ae942-815f-4761-b22e-a99a7d1fe2c5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:42.079071 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d99ae942-815f-4761-b22e-a99a7d1fe2c5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:42.079376 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d99ae942-815f-4761-b22e-a99a7d1fe2c5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:42.080082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d99ae942-815f-4761-b22e-a99a7d1fe2c5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:42.080565 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d99ae942-815f-4761-b22e-a99a7d1fe2c5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:42.081035 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d99ae942-815f-4761-b22e-a99a7d1fe2c5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:42.210253 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d99ae942-815f-4761-b22e-a99a7d1fe2c5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.148785 Aug 24 05:53:42.211783 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 455/904] 10.222.0.15 () {60 vars in 1316 bytes} [Wed Aug 24 05:53:42 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:53:43.414384 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-f5baf306-76af-41e1-9c59-c53af32ae323 req-54eb4b3d-0610-4544-b751-3e01cc6807cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96fde59-06c5-4305-b87a-9fde71a07588", "tag": "d949a0c9-9094-4077-9a1f-391953b800d1"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:43.427322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-f5baf306-76af-41e1-9c59-c53af32ae323 req-54eb4b3d-0610-4544-b751-3e01cc6807cd service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:43.428045 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-f5baf306-76af-41e1-9c59-c53af32ae323 req-54eb4b3d-0610-4544-b751-3e01cc6807cd service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:43.428790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-f5baf306-76af-41e1-9c59-c53af32ae323 req-54eb4b3d-0610-4544-b751-3e01cc6807cd service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:43.442987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-f5baf306-76af-41e1-9c59-c53af32ae323 req-54eb4b3d-0610-4544-b751-3e01cc6807cd service nova] Creating event network-changed:d949a0c9-9094-4077-9a1f-391953b800d1 for instance a96fde59-06c5-4305-b87a-9fde71a07588 on hv-cinder-85426 Aug 24 05:53:43.448917 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-f5baf306-76af-41e1-9c59-c53af32ae323 req-54eb4b3d-0610-4544-b751-3e01cc6807cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039887 Aug 24 05:53:43.449751 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 450/905] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:45.306298 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1fe092fd-c09b-4179-a0f2-aff292172098 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Action: 'create', calling method: .version_select at 0x7f064ffe6940>, body: {"keypair": {"name": "tempest-keypair-1064147333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpkAN4LhvvYseG8tTIsJ57SwLN1EErbDLtTxlvF5UBADcbKdvKy/sTiBmJSeR1Yf690HcnzBB4PmzYXIjhW0AAqpCMwl1PY8saupbA8OPCNPADkQgPex6/RYYbBrsuH1A=="}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:45.322387 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-1fe092fd-c09b-4179-a0f2-aff292172098 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Getting quotas for project dd4a461b2a2645908c8229d77e13c743. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:53:45.326657 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-1fe092fd-c09b-4179-a0f2-aff292172098 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Getting quotas for user 340c99a3e19343aab956056060a23896 and project dd4a461b2a2645908c8229d77e13c743. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:53:45.445134 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1fe092fd-c09b-4179-a0f2-aff292172098 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.299307 Aug 24 05:53:45.445822 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 456/906] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 24 05:53:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:47.884818 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1774107900", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "890e4c7a-7a6f-4e14-8fdf-39631dd95515"}], "security_groups": [{"name": "tempest-securitygroup--1949190578"}], "key_name": "tempest-keypair-1064147333", "user_data": "}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:48.042638 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] validate_networks() for [('890e4c7a-7a6f-4e14-8fdf-39631dd95515', None, None, None, None, None)] {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:53:48.488147 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:53:48.489434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:53:48.489851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:53:48.490258 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:53:48.490672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:53:48.500804 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:48.501290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:48.501726 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:48.502450 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:48.502903 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:48.503331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:48.525210 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Getting quotas for project dd4a461b2a2645908c8229d77e13c743. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:53:48.530791 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Getting quotas for user 340c99a3e19343aab956056060a23896 and project dd4a461b2a2645908c8229d77e13c743. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:53:48.549824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:53:48.554104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:53:48.709914 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3a3d8f17-ec8c-4701-9228-2f4b32b69b01 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.834613 Aug 24 05:53:48.710570 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 451/907] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:53:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:53:48.723630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f6bfbe5c-16d6-4aad-b512-317cfa1581ff tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:48.724432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f6bfbe5c-16d6-4aad-b512-317cfa1581ff tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:48.800515 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f6bfbe5c-16d6-4aad-b512-317cfa1581ff tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:48.809290 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f6bfbe5c-16d6-4aad-b512-317cfa1581ff tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1238 microversion: 2.1 time: 0.090794 Aug 24 05:53:48.825993 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 457/908] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:48 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:49.839291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-77aefc08-9dd1-4cd6-954f-73c3823d2b29 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:49.841596 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-77aefc08-9dd1-4cd6-954f-73c3823d2b29 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:49.853108 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77aefc08-9dd1-4cd6-954f-73c3823d2b29 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:49.853615 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77aefc08-9dd1-4cd6-954f-73c3823d2b29 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:49.854060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77aefc08-9dd1-4cd6-954f-73c3823d2b29 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:49.854777 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77aefc08-9dd1-4cd6-954f-73c3823d2b29 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:49.855235 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77aefc08-9dd1-4cd6-954f-73c3823d2b29 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:49.855670 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-77aefc08-9dd1-4cd6-954f-73c3823d2b29 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:49.921943 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-77aefc08-9dd1-4cd6-954f-73c3823d2b29 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:49.930721 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-77aefc08-9dd1-4cd6-954f-73c3823d2b29 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1242 microversion: 2.1 time: 0.102430 Aug 24 05:53:49.932172 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 452/909] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:49 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:50.952427 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f000b9d3-a6e8-4463-a6fc-8d62fa7d8a4d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:50.953048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f000b9d3-a6e8-4463-a6fc-8d62fa7d8a4d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:50.961018 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f000b9d3-a6e8-4463-a6fc-8d62fa7d8a4d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:50.961517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f000b9d3-a6e8-4463-a6fc-8d62fa7d8a4d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:50.961960 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f000b9d3-a6e8-4463-a6fc-8d62fa7d8a4d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:50.962685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f000b9d3-a6e8-4463-a6fc-8d62fa7d8a4d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:50.963146 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f000b9d3-a6e8-4463-a6fc-8d62fa7d8a4d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:50.963574 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f000b9d3-a6e8-4463-a6fc-8d62fa7d8a4d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:51.039061 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f000b9d3-a6e8-4463-a6fc-8d62fa7d8a4d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:51.047874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f000b9d3-a6e8-4463-a6fc-8d62fa7d8a4d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1290 microversion: 2.1 time: 0.099351 Aug 24 05:53:51.048500 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 458/910] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:50 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:52.081562 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-acea445d-0595-463f-9c98-601decb54216 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:52.082309 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-acea445d-0595-463f-9c98-601decb54216 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:52.091233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-acea445d-0595-463f-9c98-601decb54216 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:52.091233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-acea445d-0595-463f-9c98-601decb54216 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:52.091233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-acea445d-0595-463f-9c98-601decb54216 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:52.091233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-acea445d-0595-463f-9c98-601decb54216 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:52.091717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-acea445d-0595-463f-9c98-601decb54216 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:52.092106 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-acea445d-0595-463f-9c98-601decb54216 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:52.235955 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-acea445d-0595-463f-9c98-601decb54216 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:52.246982 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-acea445d-0595-463f-9c98-601decb54216 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1364 microversion: 2.1 time: 0.169375 Aug 24 05:53:52.247736 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 453/911] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:52 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:53.054746 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-b2a9ffd7-cda7-4aea-83f6-7da3871d051a req-afea3e4b-165b-453f-aa18-17f21e3688a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21cccbf8-b418-4977-900d-f4b1fa91d277", "tag": "2367aab4-1a36-48c8-bbf9-71894aaea93e"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:53.065021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b2a9ffd7-cda7-4aea-83f6-7da3871d051a req-afea3e4b-165b-453f-aa18-17f21e3688a0 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:53.065587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b2a9ffd7-cda7-4aea-83f6-7da3871d051a req-afea3e4b-165b-453f-aa18-17f21e3688a0 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:53.066096 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-b2a9ffd7-cda7-4aea-83f6-7da3871d051a req-afea3e4b-165b-453f-aa18-17f21e3688a0 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:53.077974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-b2a9ffd7-cda7-4aea-83f6-7da3871d051a req-afea3e4b-165b-453f-aa18-17f21e3688a0 service nova] Creating event network-changed:2367aab4-1a36-48c8-bbf9-71894aaea93e for instance 21cccbf8-b418-4977-900d-f4b1fa91d277 on hv-cinder-85426 Aug 24 05:53:53.083694 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-b2a9ffd7-cda7-4aea-83f6-7da3871d051a req-afea3e4b-165b-453f-aa18-17f21e3688a0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033256 Aug 24 05:53:53.084285 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 459/912] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:53:53.270642 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ec1ef532-e1ee-469f-950e-027da75e355a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:53.271183 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ec1ef532-e1ee-469f-950e-027da75e355a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:53.278000 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ec1ef532-e1ee-469f-950e-027da75e355a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:53.278498 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ec1ef532-e1ee-469f-950e-027da75e355a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:53.278996 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ec1ef532-e1ee-469f-950e-027da75e355a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:53.279666 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ec1ef532-e1ee-469f-950e-027da75e355a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:53.280128 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ec1ef532-e1ee-469f-950e-027da75e355a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:53.280594 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ec1ef532-e1ee-469f-950e-027da75e355a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:53.428427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ec1ef532-e1ee-469f-950e-027da75e355a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:53.436918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ec1ef532-e1ee-469f-950e-027da75e355a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1364 microversion: 2.1 time: 0.170839 Aug 24 05:53:53.437512 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 454/913] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:53 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:54.461209 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bff638db-27d4-48b6-8870-e94652d71d7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:54.461950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bff638db-27d4-48b6-8870-e94652d71d7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:54.468542 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bff638db-27d4-48b6-8870-e94652d71d7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:54.469044 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bff638db-27d4-48b6-8870-e94652d71d7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:54.469492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bff638db-27d4-48b6-8870-e94652d71d7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:54.470220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bff638db-27d4-48b6-8870-e94652d71d7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:54.470682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bff638db-27d4-48b6-8870-e94652d71d7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:54.471112 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bff638db-27d4-48b6-8870-e94652d71d7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:54.617642 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bff638db-27d4-48b6-8870-e94652d71d7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:54.625776 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bff638db-27d4-48b6-8870-e94652d71d7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1364 microversion: 2.1 time: 0.170104 Aug 24 05:53:54.626363 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 460/914] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:54 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:55.651140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e1043d09-e4f0-4522-8078-88e1ba3f9385 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:55.652454 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e1043d09-e4f0-4522-8078-88e1ba3f9385 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:55.663713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1043d09-e4f0-4522-8078-88e1ba3f9385 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:55.664202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1043d09-e4f0-4522-8078-88e1ba3f9385 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:55.664677 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1043d09-e4f0-4522-8078-88e1ba3f9385 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:55.665469 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1043d09-e4f0-4522-8078-88e1ba3f9385 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:55.666015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1043d09-e4f0-4522-8078-88e1ba3f9385 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:55.666440 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e1043d09-e4f0-4522-8078-88e1ba3f9385 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:55.804852 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e1043d09-e4f0-4522-8078-88e1ba3f9385 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:55.812664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e1043d09-e4f0-4522-8078-88e1ba3f9385 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1364 microversion: 2.1 time: 0.169737 Aug 24 05:53:55.813234 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 455/915] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:55 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:56.834509 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8e87070f-1859-411b-bc8b-a68f900dc82f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:56.835323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8e87070f-1859-411b-bc8b-a68f900dc82f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:56.842117 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e87070f-1859-411b-bc8b-a68f900dc82f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:56.842609 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e87070f-1859-411b-bc8b-a68f900dc82f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:56.843050 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e87070f-1859-411b-bc8b-a68f900dc82f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:56.843830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e87070f-1859-411b-bc8b-a68f900dc82f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:56.844295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e87070f-1859-411b-bc8b-a68f900dc82f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:56.844752 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e87070f-1859-411b-bc8b-a68f900dc82f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:56.983934 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8e87070f-1859-411b-bc8b-a68f900dc82f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:56.993006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8e87070f-1859-411b-bc8b-a68f900dc82f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1364 microversion: 2.1 time: 0.163176 Aug 24 05:53:56.993585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 461/916] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:56 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:58.014673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4ab42a7b-1694-46e5-bba6-8312adb5d884 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:58.015297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4ab42a7b-1694-46e5-bba6-8312adb5d884 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:58.017869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:58.023467 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ab42a7b-1694-46e5-bba6-8312adb5d884 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:58.030285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ab42a7b-1694-46e5-bba6-8312adb5d884 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:58.030285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ab42a7b-1694-46e5-bba6-8312adb5d884 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:58.030285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ab42a7b-1694-46e5-bba6-8312adb5d884 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:58.030285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ab42a7b-1694-46e5-bba6-8312adb5d884 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:58.030672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4ab42a7b-1694-46e5-bba6-8312adb5d884 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:58.182379 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4ab42a7b-1694-46e5-bba6-8312adb5d884 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:58.191229 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4ab42a7b-1694-46e5-bba6-8312adb5d884 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1364 microversion: 2.1 time: 0.180465 Aug 24 05:53:58.192710 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 456/917] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:58 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:59.047817 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5b88daea-adc1-4175-9a6d-aa013048c68c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:59.048943 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5b88daea-adc1-4175-9a6d-aa013048c68c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:59.051602 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=6 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:59.056732 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5b88daea-adc1-4175-9a6d-aa013048c68c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:59.057433 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5b88daea-adc1-4175-9a6d-aa013048c68c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:59.057974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5b88daea-adc1-4175-9a6d-aa013048c68c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:59.063335 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5b88daea-adc1-4175-9a6d-aa013048c68c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:59.063335 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5b88daea-adc1-4175-9a6d-aa013048c68c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:59.063335 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5b88daea-adc1-4175-9a6d-aa013048c68c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:59.065543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=69 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:59.088167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5b88daea-adc1-4175-9a6d-aa013048c68c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/ips" status: 200 len: 151 microversion: 2.1 time: 0.045130 Aug 24 05:53:59.090446 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 462/918] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 24 05:53:59 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:53:59.210253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:59.211037 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=6 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:59.215622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-15264f9b-92e6-4ff4-97cb-23223d97b1ef tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:59.216250 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-15264f9b-92e6-4ff4-97cb-23223d97b1ef tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:59.222808 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15264f9b-92e6-4ff4-97cb-23223d97b1ef tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:59.224132 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15264f9b-92e6-4ff4-97cb-23223d97b1ef tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:59.224132 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15264f9b-92e6-4ff4-97cb-23223d97b1ef tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:59.224605 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15264f9b-92e6-4ff4-97cb-23223d97b1ef tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:59.225275 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15264f9b-92e6-4ff4-97cb-23223d97b1ef tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:59.225573 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15264f9b-92e6-4ff4-97cb-23223d97b1ef tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:59.374664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-15264f9b-92e6-4ff4-97cb-23223d97b1ef tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:59.388644 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-15264f9b-92e6-4ff4-97cb-23223d97b1ef tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1364 microversion: 2.1 time: 0.178580 Aug 24 05:53:59.389896 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 457/919] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:59 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:00.298674 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-74a98558-2234-4661-8284-0329aa0f1b63 req-84e62176-4779-4c71-adb5-f5a5f390d1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21cccbf8-b418-4977-900d-f4b1fa91d277", "name": "network-vif-plugged", "status": "completed", "tag": "2367aab4-1a36-48c8-bbf9-71894aaea93e"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:00.315878 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-74a98558-2234-4661-8284-0329aa0f1b63 req-84e62176-4779-4c71-adb5-f5a5f390d1ee service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:00.319595 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-74a98558-2234-4661-8284-0329aa0f1b63 req-84e62176-4779-4c71-adb5-f5a5f390d1ee service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:00.319595 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-74a98558-2234-4661-8284-0329aa0f1b63 req-84e62176-4779-4c71-adb5-f5a5f390d1ee service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:00.336087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-74a98558-2234-4661-8284-0329aa0f1b63 req-84e62176-4779-4c71-adb5-f5a5f390d1ee service nova] Creating event network-vif-plugged:2367aab4-1a36-48c8-bbf9-71894aaea93e for instance 21cccbf8-b418-4977-900d-f4b1fa91d277 on hv-cinder-85426 Aug 24 05:54:00.342067 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-74a98558-2234-4661-8284-0329aa0f1b63 req-84e62176-4779-4c71-adb5-f5a5f390d1ee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050140 Aug 24 05:54:00.342770 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 463/920] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:00.412375 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e25898ab-2d35-4111-a016-25937faefc6b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:00.412375 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e25898ab-2d35-4111-a016-25937faefc6b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:00.420154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e25898ab-2d35-4111-a016-25937faefc6b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:00.420698 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e25898ab-2d35-4111-a016-25937faefc6b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:00.421142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e25898ab-2d35-4111-a016-25937faefc6b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:00.421931 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e25898ab-2d35-4111-a016-25937faefc6b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:00.422665 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e25898ab-2d35-4111-a016-25937faefc6b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:00.423091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e25898ab-2d35-4111-a016-25937faefc6b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:00.595672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e25898ab-2d35-4111-a016-25937faefc6b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:00.605444 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e25898ab-2d35-4111-a016-25937faefc6b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1364 microversion: 2.1 time: 0.197940 Aug 24 05:54:00.606031 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 458/921] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:00 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:01.628992 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f94101d6-9225-40f6-ae16-cc4a96a728b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:01.629943 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f94101d6-9225-40f6-ae16-cc4a96a728b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:01.636474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f94101d6-9225-40f6-ae16-cc4a96a728b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:01.636972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f94101d6-9225-40f6-ae16-cc4a96a728b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:01.637413 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f94101d6-9225-40f6-ae16-cc4a96a728b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:01.638128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f94101d6-9225-40f6-ae16-cc4a96a728b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:01.638589 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f94101d6-9225-40f6-ae16-cc4a96a728b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:01.639017 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f94101d6-9225-40f6-ae16-cc4a96a728b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:01.786850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f94101d6-9225-40f6-ae16-cc4a96a728b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:01.798045 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f94101d6-9225-40f6-ae16-cc4a96a728b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1364 microversion: 2.1 time: 0.173967 Aug 24 05:54:01.799426 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 464/922] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:01 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:01.860374 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7089d2d2-35fd-415b-9f24-870cc7eabe4e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4665bbfe-34b4-4ee0-a84f-3f34ad6f586c"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:01.862854 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7089d2d2-35fd-415b-9f24-870cc7eabe4e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:01.869958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7089d2d2-35fd-415b-9f24-870cc7eabe4e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:01.870445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7089d2d2-35fd-415b-9f24-870cc7eabe4e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:01.870891 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7089d2d2-35fd-415b-9f24-870cc7eabe4e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:01.871596 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7089d2d2-35fd-415b-9f24-870cc7eabe4e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:01.872051 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7089d2d2-35fd-415b-9f24-870cc7eabe4e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:01.872507 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7089d2d2-35fd-415b-9f24-870cc7eabe4e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:02.821092 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8f052030-51ff-4ec1-afee-3f32ed284339 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:02.821721 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8f052030-51ff-4ec1-afee-3f32ed284339 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:02.828101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f052030-51ff-4ec1-afee-3f32ed284339 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:02.828620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f052030-51ff-4ec1-afee-3f32ed284339 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:02.829082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f052030-51ff-4ec1-afee-3f32ed284339 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:02.829793 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f052030-51ff-4ec1-afee-3f32ed284339 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:02.830256 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f052030-51ff-4ec1-afee-3f32ed284339 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:02.830729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f052030-51ff-4ec1-afee-3f32ed284339 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:02.848837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7089d2d2-35fd-415b-9f24-870cc7eabe4e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991445 Aug 24 05:54:02.849704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 459/923] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 05:54:01 2022] POST /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:02.982884 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8f052030-51ff-4ec1-afee-3f32ed284339 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:02.991180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8f052030-51ff-4ec1-afee-3f32ed284339 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1364 microversion: 2.1 time: 0.174191 Aug 24 05:54:02.991748 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 465/924] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:02 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:54:04.012909 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6eb35255-56d5-4cea-a5c2-739a9d1c87c3 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:04.013644 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6eb35255-56d5-4cea-a5c2-739a9d1c87c3 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:04.019901 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb35255-56d5-4cea-a5c2-739a9d1c87c3 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:04.020456 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb35255-56d5-4cea-a5c2-739a9d1c87c3 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:04.020900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb35255-56d5-4cea-a5c2-739a9d1c87c3 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:04.021598 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb35255-56d5-4cea-a5c2-739a9d1c87c3 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:04.022091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb35255-56d5-4cea-a5c2-739a9d1c87c3 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:04.022522 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6eb35255-56d5-4cea-a5c2-739a9d1c87c3 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:04.161341 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6eb35255-56d5-4cea-a5c2-739a9d1c87c3 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:04.169236 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6eb35255-56d5-4cea-a5c2-739a9d1c87c3 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1550 microversion: 2.1 time: 0.161157 Aug 24 05:54:04.169806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 460/925] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:04 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:04.190806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3b74ab24-ae26-4f5c-8341-71bb2e977287 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:04.191303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3b74ab24-ae26-4f5c-8341-71bb2e977287 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:04.198486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3b74ab24-ae26-4f5c-8341-71bb2e977287 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:04.198968 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3b74ab24-ae26-4f5c-8341-71bb2e977287 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:04.199407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3b74ab24-ae26-4f5c-8341-71bb2e977287 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:04.200105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3b74ab24-ae26-4f5c-8341-71bb2e977287 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:04.200594 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3b74ab24-ae26-4f5c-8341-71bb2e977287 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:04.201026 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3b74ab24-ae26-4f5c-8341-71bb2e977287 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:04.279750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3b74ab24-ae26-4f5c-8341-71bb2e977287 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092759 Aug 24 05:54:04.280342 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 466/926] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 24 05:54:04 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:05.548091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-80ce3b46-058a-4560-97f1-94046c1c8001 req-0c32bfc2-754c-4d7c-938b-f01347b4d887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21cccbf8-b418-4977-900d-f4b1fa91d277", "tag": "2367aab4-1a36-48c8-bbf9-71894aaea93e"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:05.558275 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-80ce3b46-058a-4560-97f1-94046c1c8001 req-0c32bfc2-754c-4d7c-938b-f01347b4d887 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:05.558781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-80ce3b46-058a-4560-97f1-94046c1c8001 req-0c32bfc2-754c-4d7c-938b-f01347b4d887 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:05.559215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-80ce3b46-058a-4560-97f1-94046c1c8001 req-0c32bfc2-754c-4d7c-938b-f01347b4d887 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:05.570839 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-80ce3b46-058a-4560-97f1-94046c1c8001 req-0c32bfc2-754c-4d7c-938b-f01347b4d887 service nova] Creating event network-changed:2367aab4-1a36-48c8-bbf9-71894aaea93e for instance 21cccbf8-b418-4977-900d-f4b1fa91d277 on hv-cinder-85426 Aug 24 05:54:05.576062 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-80ce3b46-058a-4560-97f1-94046c1c8001 req-0c32bfc2-754c-4d7c-938b-f01347b4d887 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031882 Aug 24 05:54:05.576696 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 461/927] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:11.450573 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4665bbfe-34b4-4ee0-a84f-3f34ad6f586c"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:11.452887 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:11.458940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:11.459418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:11.459847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:11.460562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:11.461019 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:11.461443 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:11.541110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Invalid volume: volume 4665bbfe-34b4-4ee0-a84f-3f34ad6f586c is already attached to instances: 37f911fc-26ef-4d88-a68f-68413310a1dc Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: POST /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments HTTP/1.1 Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 74 Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:54:11.542858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {"volumeAttachment": {"volumeId": "4665bbfe-34b4-4ee0-a84f-3f34ad6f586c"}} Aug 24 05:54:11.544555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Invalid volume: volume 4665bbfe-34b4-4ee0-a84f-3f34ad6f586c is already attached to instances: 37f911fc-26ef-4d88-a68f-68413310a1dc Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'server_id': '37f911fc-26ef-4d88-a68f-68413310a1dc', 'body': {'volumeAttachment': {'volumeId': '4665bbfe-34b4-4ee0-a84f-3f34ad6f586c'}}} Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4665bbfe-34b4-4ee0-a84f-3f34ad6f586c is already attached to instances: 37f911fc-26ef-4d88-a68f-68413310a1dc Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:54:11.545444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4665bbfe-34b4-4ee0-a84f-3f34ad6f586c is already attached to instances: 37f911fc-26ef-4d88-a68f-68413310a1dc Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:54:11.546685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:54:11.548223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:54:11.548223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:54:11.548223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:54:11.548223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4665bbfe-34b4-4ee0-a84f-3f34ad6f586c is already attached to instances: 37f911fc-26ef-4d88-a68f-68413310a1dc Aug 24 05:54:11.548223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:54:11.548223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 400 to user: Invalid volume: volume 4665bbfe-34b4-4ee0-a84f-3f34ad6f586c is already attached to instances: 37f911fc-26ef-4d88-a68f-68413310a1dc {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:54:11.548223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e54d2ef8-0140-435e-b781-f201dfb6bdf2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098374 Aug 24 05:54:11.548223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 467/928] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 05:54:11 2022] POST /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:54:11.610938 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-179d4b57-5bed-4e48-b08c-1bd016cf3db8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:11.611530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-179d4b57-5bed-4e48-b08c-1bd016cf3db8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:11.619382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-179d4b57-5bed-4e48-b08c-1bd016cf3db8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:11.619877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-179d4b57-5bed-4e48-b08c-1bd016cf3db8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:11.620331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-179d4b57-5bed-4e48-b08c-1bd016cf3db8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:11.621059 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-179d4b57-5bed-4e48-b08c-1bd016cf3db8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:11.621577 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-179d4b57-5bed-4e48-b08c-1bd016cf3db8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:11.622005 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-179d4b57-5bed-4e48-b08c-1bd016cf3db8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:11.624760 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:11.706847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-179d4b57-5bed-4e48-b08c-1bd016cf3db8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lazy-loading 'services' on Instance uuid 37f911fc-26ef-4d88-a68f-68413310a1dc {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:54:11.974635 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-179d4b57-5bed-4e48-b08c-1bd016cf3db8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments/4665bbfe-34b4-4ee0-a84f-3f34ad6f586c" status: 202 len: 0 microversion: 2.1 time: 0.367627 Aug 24 05:54:11.975157 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 462/929] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 05:54:11 2022] DELETE /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments/4665bbfe-34b4-4ee0-a84f-3f34ad6f586c => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:54:11.983775 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6dd6de9c-8a3d-410a-aa77-03b6241b7aeb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:11.986003 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6dd6de9c-8a3d-410a-aa77-03b6241b7aeb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:11.994225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dd6de9c-8a3d-410a-aa77-03b6241b7aeb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:11.994711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dd6de9c-8a3d-410a-aa77-03b6241b7aeb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:11.995158 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dd6de9c-8a3d-410a-aa77-03b6241b7aeb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:11.995858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dd6de9c-8a3d-410a-aa77-03b6241b7aeb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:11.996315 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dd6de9c-8a3d-410a-aa77-03b6241b7aeb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:11.996784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6dd6de9c-8a3d-410a-aa77-03b6241b7aeb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:12.028999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6dd6de9c-8a3d-410a-aa77-03b6241b7aeb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049314 Aug 24 05:54:12.029556 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 468/930] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:54:11 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:13.043154 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ea09a089-cdd6-4888-bb92-4d24479e25e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:13.045527 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ea09a089-cdd6-4888-bb92-4d24479e25e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:13.053178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea09a089-cdd6-4888-bb92-4d24479e25e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:13.053674 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea09a089-cdd6-4888-bb92-4d24479e25e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:13.054123 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea09a089-cdd6-4888-bb92-4d24479e25e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:13.054832 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea09a089-cdd6-4888-bb92-4d24479e25e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:13.055292 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea09a089-cdd6-4888-bb92-4d24479e25e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:13.055724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ea09a089-cdd6-4888-bb92-4d24479e25e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:13.101264 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ea09a089-cdd6-4888-bb92-4d24479e25e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063289 Aug 24 05:54:13.101847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 463/931] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:54:13 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:14.114728 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-92102dc4-489c-4b9e-9080-adda730049e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:14.117060 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-92102dc4-489c-4b9e-9080-adda730049e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:14.119641 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:14.124184 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92102dc4-489c-4b9e-9080-adda730049e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:14.124699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92102dc4-489c-4b9e-9080-adda730049e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:14.125131 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92102dc4-489c-4b9e-9080-adda730049e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:14.125866 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92102dc4-489c-4b9e-9080-adda730049e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:14.126342 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92102dc4-489c-4b9e-9080-adda730049e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:14.126772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-92102dc4-489c-4b9e-9080-adda730049e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:14.175359 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-92102dc4-489c-4b9e-9080-adda730049e0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065051 Aug 24 05:54:14.175929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 469/932] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:54:14 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:54:14.237928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4b1f5d37-4104-42a8-adc7-0747d7678dcb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:14.238476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4b1f5d37-4104-42a8-adc7-0747d7678dcb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:14.245020 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b1f5d37-4104-42a8-adc7-0747d7678dcb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:14.245508 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b1f5d37-4104-42a8-adc7-0747d7678dcb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:14.245950 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b1f5d37-4104-42a8-adc7-0747d7678dcb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:14.246639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b1f5d37-4104-42a8-adc7-0747d7678dcb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:14.247099 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b1f5d37-4104-42a8-adc7-0747d7678dcb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:14.247587 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4b1f5d37-4104-42a8-adc7-0747d7678dcb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:14.273375 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4b1f5d37-4104-42a8-adc7-0747d7678dcb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:54:14.563704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4b1f5d37-4104-42a8-adc7-0747d7678dcb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 204 len: 0 microversion: 2.1 time: 0.329196 Aug 24 05:54:14.564342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 464/933] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:54:14 2022] DELETE /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:54:14.573932 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ab26d0eb-df64-4831-9466-27d8ccf91445 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:14.574531 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ab26d0eb-df64-4831-9466-27d8ccf91445 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:14.580649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab26d0eb-df64-4831-9466-27d8ccf91445 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:14.588520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab26d0eb-df64-4831-9466-27d8ccf91445 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:14.588520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab26d0eb-df64-4831-9466-27d8ccf91445 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:14.588520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab26d0eb-df64-4831-9466-27d8ccf91445 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:14.588520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab26d0eb-df64-4831-9466-27d8ccf91445 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:14.588943 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ab26d0eb-df64-4831-9466-27d8ccf91445 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:14.713112 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ab26d0eb-df64-4831-9466-27d8ccf91445 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:14.720900 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ab26d0eb-df64-4831-9466-27d8ccf91445 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1682 microversion: 2.1 time: 0.151181 Aug 24 05:54:14.721455 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 470/934] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:14 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:15.742571 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-00a871a2-39c7-4cc1-9228-71efc01056f4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:15.743261 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-00a871a2-39c7-4cc1-9228-71efc01056f4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:15.749706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-00a871a2-39c7-4cc1-9228-71efc01056f4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:15.750187 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-00a871a2-39c7-4cc1-9228-71efc01056f4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:15.750618 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-00a871a2-39c7-4cc1-9228-71efc01056f4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:15.751338 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-00a871a2-39c7-4cc1-9228-71efc01056f4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:15.751752 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-00a871a2-39c7-4cc1-9228-71efc01056f4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:15.752168 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-00a871a2-39c7-4cc1-9228-71efc01056f4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:15.892746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-00a871a2-39c7-4cc1-9228-71efc01056f4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:15.902500 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-00a871a2-39c7-4cc1-9228-71efc01056f4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1682 microversion: 2.1 time: 0.164218 Aug 24 05:54:15.904940 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 465/935] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:15 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:16.928113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b2b504c8-d023-49f9-bae1-ccf165b820ab tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:16.928698 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b2b504c8-d023-49f9-bae1-ccf165b820ab tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:16.934714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2b504c8-d023-49f9-bae1-ccf165b820ab tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:16.935189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2b504c8-d023-49f9-bae1-ccf165b820ab tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:16.935619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2b504c8-d023-49f9-bae1-ccf165b820ab tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:16.936301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2b504c8-d023-49f9-bae1-ccf165b820ab tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:16.936775 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2b504c8-d023-49f9-bae1-ccf165b820ab tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:16.937195 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2b504c8-d023-49f9-bae1-ccf165b820ab tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:17.076820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b2b504c8-d023-49f9-bae1-ccf165b820ab tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:17.086664 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b2b504c8-d023-49f9-bae1-ccf165b820ab tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1682 microversion: 2.1 time: 0.162821 Aug 24 05:54:17.087414 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 471/936] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:16 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:54:17.981119 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-5d1707dc-e1db-46fa-8919-588e28fe9c41 req-283fb807-b1ec-415e-8c37-1025fcf691ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f911fc-26ef-4d88-a68f-68413310a1dc", "name": "network-vif-deleted", "tag": "188f2894-ead0-4877-a3d5-4f06bfdf2291"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:17.991461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5d1707dc-e1db-46fa-8919-588e28fe9c41 req-283fb807-b1ec-415e-8c37-1025fcf691ba service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:17.996969 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5d1707dc-e1db-46fa-8919-588e28fe9c41 req-283fb807-b1ec-415e-8c37-1025fcf691ba service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:17.996969 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5d1707dc-e1db-46fa-8919-588e28fe9c41 req-283fb807-b1ec-415e-8c37-1025fcf691ba service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:18.005711 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-5d1707dc-e1db-46fa-8919-588e28fe9c41 req-283fb807-b1ec-415e-8c37-1025fcf691ba service nova] Creating event network-vif-deleted:188f2894-ead0-4877-a3d5-4f06bfdf2291 for instance 37f911fc-26ef-4d88-a68f-68413310a1dc on hv-cinder-85426 Aug 24 05:54:18.011415 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-5d1707dc-e1db-46fa-8919-588e28fe9c41 req-283fb807-b1ec-415e-8c37-1025fcf691ba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033843 Aug 24 05:54:18.012359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 466/937] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:18.114483 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-78676e9b-e685-4bca-b60a-c3fdb6acd938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:18.115865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-78676e9b-e685-4bca-b60a-c3fdb6acd938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:18.122375 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78676e9b-e685-4bca-b60a-c3fdb6acd938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:18.122869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78676e9b-e685-4bca-b60a-c3fdb6acd938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:18.123308 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78676e9b-e685-4bca-b60a-c3fdb6acd938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:18.124056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78676e9b-e685-4bca-b60a-c3fdb6acd938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:18.124511 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78676e9b-e685-4bca-b60a-c3fdb6acd938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:18.125141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78676e9b-e685-4bca-b60a-c3fdb6acd938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:18.199392 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-78676e9b-e685-4bca-b60a-c3fdb6acd938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:18.207098 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-78676e9b-e685-4bca-b60a-c3fdb6acd938 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 200 len: 1614 microversion: 2.1 time: 0.097229 Aug 24 05:54:18.207708 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 472/938] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:18 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:54:19.230446 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:19.231063 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:19.237832 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:19.242540 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:19.242540 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:19.242540 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:19.242540 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:19.242990 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:19.254083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc HTTP/1.1 Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:54:19.255921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:54:19.257716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '37f911fc-26ef-4d88-a68f-68413310a1dc'} Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:54:19.258806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:54:19.260641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:54:19.262330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:54:19.262330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f5d54e3b-697a-496c-8b83-db2a2d2fdf0f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 404 len: 111 microversion: 2.1 time: 0.032077 Aug 24 05:54:19.262330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 467/939] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:19 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:54:19.266555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ac75fdea-7bf5-472f-956e-578a28eaebb1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '.version_select at 0x7f065c100f70>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:19.356664 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ac75fdea-7bf5-472f-956e-578a28eaebb1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-63496810" status: 202 len: 0 microversion: 2.1 time: 0.094038 Aug 24 05:54:19.357245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 473/940] 10.222.0.15 () {58 vars in 1215 bytes} [Wed Aug 24 05:54:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-63496810 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:54:20.157879 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b8c749de-4a9c-40a2-ab6c-2ecdf25a96a3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: .version_select at 0x7f064fee8280>, body: {"keypair": {"name": "tempest-keypair-1627386111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxgSl6VM5ZcNF1dENye6TAYtrHKxD+kNLBJEnRE7eFjivwhKBgtcG5uwkz9duK2DurlwFdf/eVS2aobCQ8A1cmaxaCNLEGzpKbo2NlL97zIMihgk6WDTTjf8Mow8R1uqw=="}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:20.174472 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-b8c749de-4a9c-40a2-ab6c-2ecdf25a96a3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'key_pairs'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:54:20.179406 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-b8c749de-4a9c-40a2-ab6c-2ecdf25a96a3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for user d3e6e20d5cd44444b43b1e7abb240f8d and project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'key_pairs'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:54:20.294100 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b8c749de-4a9c-40a2-ab6c-2ecdf25a96a3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139912 Aug 24 05:54:20.295575 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 468/941] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 24 05:54:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:22.707241 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1762834111", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf3d5dbf-6bc3-460c-95aa-1bef35e2fd6f"}], "security_groups": [{"name": "tempest-securitygroup--746145535"}], "key_name": "tempest-keypair-1627386111", "user_data": "}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:22.809986 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.network.neutron [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] validate_networks() for [('cf3d5dbf-6bc3-460c-95aa-1bef35e2fd6f', None, None, None, None, None)] {{(pid=127756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:54:23.191857 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Flavor limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:54:23.192879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Image limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:54:23.193348 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Flavor pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:54:23.193749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Image pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:54:23.194155 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:54:23.202797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:23.203271 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:23.203698 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:23.204417 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:23.204884 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:23.205302 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:23.221521 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:54:23.226156 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Getting quotas for user d3e6e20d5cd44444b43b1e7abb240f8d and project cfbd03315ded40279308fcc7f0dde7cb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:54:23.236965 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Going to run 1 instances... {{(pid=127756) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:54:23.239872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:54:23.369850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1be68c86-4548-4067-bb88-1e370690c7d5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.667591 Aug 24 05:54:23.370512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 474/942] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:54:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:54:23.382065 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e259d095-0d19-4508-8315-cc39346221ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:23.382698 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e259d095-0d19-4508-8315-cc39346221ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:23.442062 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e259d095-0d19-4508-8315-cc39346221ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:23.449266 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e259d095-0d19-4508-8315-cc39346221ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1242 microversion: 2.1 time: 0.071723 Aug 24 05:54:23.449837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 469/943] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:23 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:24.469865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c53e1706-b983-4d26-9133-88d454ebcbdb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:24.470398 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c53e1706-b983-4d26-9133-88d454ebcbdb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:24.477860 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c53e1706-b983-4d26-9133-88d454ebcbdb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:24.478339 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c53e1706-b983-4d26-9133-88d454ebcbdb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:24.478771 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c53e1706-b983-4d26-9133-88d454ebcbdb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:24.479453 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c53e1706-b983-4d26-9133-88d454ebcbdb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:24.479925 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c53e1706-b983-4d26-9133-88d454ebcbdb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:24.480326 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c53e1706-b983-4d26-9133-88d454ebcbdb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:24.644360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c53e1706-b983-4d26-9133-88d454ebcbdb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:24.652552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c53e1706-b983-4d26-9133-88d454ebcbdb tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1246 microversion: 2.1 time: 0.187116 Aug 24 05:54:24.653109 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 475/944] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:24 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1246 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:25.673560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c40dc889-f9e7-4618-82a1-caaf95fa01c4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:25.674325 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c40dc889-f9e7-4618-82a1-caaf95fa01c4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:25.681151 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c40dc889-f9e7-4618-82a1-caaf95fa01c4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:25.681632 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c40dc889-f9e7-4618-82a1-caaf95fa01c4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:25.682070 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c40dc889-f9e7-4618-82a1-caaf95fa01c4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:25.682765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c40dc889-f9e7-4618-82a1-caaf95fa01c4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:25.683219 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c40dc889-f9e7-4618-82a1-caaf95fa01c4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:25.683648 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c40dc889-f9e7-4618-82a1-caaf95fa01c4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:25.799486 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c40dc889-f9e7-4618-82a1-caaf95fa01c4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:25.807709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c40dc889-f9e7-4618-82a1-caaf95fa01c4 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1312 microversion: 2.1 time: 0.138332 Aug 24 05:54:25.808504 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 470/945] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:25 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1312 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:26.827777 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f2a30d83-0b36-4b46-9427-239e33d6394f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:26.828504 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f2a30d83-0b36-4b46-9427-239e33d6394f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:26.835804 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f2a30d83-0b36-4b46-9427-239e33d6394f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:26.836955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f2a30d83-0b36-4b46-9427-239e33d6394f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:26.836955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f2a30d83-0b36-4b46-9427-239e33d6394f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:26.837472 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f2a30d83-0b36-4b46-9427-239e33d6394f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:26.837928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f2a30d83-0b36-4b46-9427-239e33d6394f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:26.838355 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f2a30d83-0b36-4b46-9427-239e33d6394f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:26.977593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f2a30d83-0b36-4b46-9427-239e33d6394f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:26.985375 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f2a30d83-0b36-4b46-9427-239e33d6394f tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1367 microversion: 2.1 time: 0.161598 Aug 24 05:54:26.985975 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 476/946] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:26 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:54:27.089841 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-44b4a528-a898-45cf-9860-b266ef3b2a08 req-6224a821-4c1f-40ca-8cb0-d46a003633be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02332736-ea71-45a8-b925-34196e98d20f", "tag": "ea01c152-11a1-41f8-89ca-aa117e6edb62"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:27.112028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-44b4a528-a898-45cf-9860-b266ef3b2a08 req-6224a821-4c1f-40ca-8cb0-d46a003633be service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:27.112028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-44b4a528-a898-45cf-9860-b266ef3b2a08 req-6224a821-4c1f-40ca-8cb0-d46a003633be service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:27.112028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-44b4a528-a898-45cf-9860-b266ef3b2a08 req-6224a821-4c1f-40ca-8cb0-d46a003633be service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:27.121107 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-44b4a528-a898-45cf-9860-b266ef3b2a08 req-6224a821-4c1f-40ca-8cb0-d46a003633be service nova] Creating event network-changed:ea01c152-11a1-41f8-89ca-aa117e6edb62 for instance 02332736-ea71-45a8-b925-34196e98d20f on hv-cinder-85426 Aug 24 05:54:27.126598 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-44b4a528-a898-45cf-9860-b266ef3b2a08 req-6224a821-4c1f-40ca-8cb0-d46a003633be service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040464 Aug 24 05:54:27.127264 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 471/947] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:28.007037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8e35e134-327c-41c1-a657-ce77432cddc6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:28.007836 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8e35e134-327c-41c1-a657-ce77432cddc6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:28.014445 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e35e134-327c-41c1-a657-ce77432cddc6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:28.014928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e35e134-327c-41c1-a657-ce77432cddc6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:28.015373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e35e134-327c-41c1-a657-ce77432cddc6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:28.016074 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e35e134-327c-41c1-a657-ce77432cddc6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:28.016567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e35e134-327c-41c1-a657-ce77432cddc6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:28.016996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8e35e134-327c-41c1-a657-ce77432cddc6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:28.149702 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8e35e134-327c-41c1-a657-ce77432cddc6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:28.157659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8e35e134-327c-41c1-a657-ce77432cddc6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1367 microversion: 2.1 time: 0.155117 Aug 24 05:54:28.158222 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 477/948] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:28 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:29.180543 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-31ca283f-d7a7-4d2d-af4d-667efd81c6c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:29.181077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-31ca283f-d7a7-4d2d-af4d-667efd81c6c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:29.183039 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:29.188146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31ca283f-d7a7-4d2d-af4d-667efd81c6c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:29.188682 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31ca283f-d7a7-4d2d-af4d-667efd81c6c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:29.189170 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31ca283f-d7a7-4d2d-af4d-667efd81c6c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:29.189877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31ca283f-d7a7-4d2d-af4d-667efd81c6c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:29.190366 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31ca283f-d7a7-4d2d-af4d-667efd81c6c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:29.190803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-31ca283f-d7a7-4d2d-af4d-667efd81c6c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:29.325794 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-31ca283f-d7a7-4d2d-af4d-667efd81c6c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:29.334029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-31ca283f-d7a7-4d2d-af4d-667efd81c6c1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1367 microversion: 2.1 time: 0.159066 Aug 24 05:54:29.334579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 472/949] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:29 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:30.354531 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c93b367d-e2c5-4803-a5e4-1253b821e6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:30.355169 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c93b367d-e2c5-4803-a5e4-1253b821e6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:30.361997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c93b367d-e2c5-4803-a5e4-1253b821e6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:30.362493 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c93b367d-e2c5-4803-a5e4-1253b821e6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:30.362936 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c93b367d-e2c5-4803-a5e4-1253b821e6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:30.363676 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c93b367d-e2c5-4803-a5e4-1253b821e6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:30.364138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c93b367d-e2c5-4803-a5e4-1253b821e6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:30.364602 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c93b367d-e2c5-4803-a5e4-1253b821e6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:30.367240 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=78 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:30.499080 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c93b367d-e2c5-4803-a5e4-1253b821e6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:30.507399 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c93b367d-e2c5-4803-a5e4-1253b821e6c6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1367 microversion: 2.1 time: 0.156704 Aug 24 05:54:30.507966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 478/950] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:30 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:31.528805 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-08518a49-92be-4563-adb3-15f06b156976 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:31.529365 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-08518a49-92be-4563-adb3-15f06b156976 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:31.536461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08518a49-92be-4563-adb3-15f06b156976 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:31.537148 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08518a49-92be-4563-adb3-15f06b156976 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:31.537590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08518a49-92be-4563-adb3-15f06b156976 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:31.538291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08518a49-92be-4563-adb3-15f06b156976 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:31.538753 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08518a49-92be-4563-adb3-15f06b156976 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:31.539181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-08518a49-92be-4563-adb3-15f06b156976 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:31.670308 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-08518a49-92be-4563-adb3-15f06b156976 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:31.682108 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-08518a49-92be-4563-adb3-15f06b156976 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1367 microversion: 2.1 time: 0.157312 Aug 24 05:54:31.682715 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 473/951] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:31 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:32.704309 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d7784597-0a73-4578-908f-b7d4f5ab3ba6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:32.704884 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d7784597-0a73-4578-908f-b7d4f5ab3ba6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:32.712573 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d7784597-0a73-4578-908f-b7d4f5ab3ba6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:32.720562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d7784597-0a73-4578-908f-b7d4f5ab3ba6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:32.720562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d7784597-0a73-4578-908f-b7d4f5ab3ba6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:32.720562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d7784597-0a73-4578-908f-b7d4f5ab3ba6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:32.720562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d7784597-0a73-4578-908f-b7d4f5ab3ba6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:32.720985 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d7784597-0a73-4578-908f-b7d4f5ab3ba6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:32.866280 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d7784597-0a73-4578-908f-b7d4f5ab3ba6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:32.874133 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d7784597-0a73-4578-908f-b7d4f5ab3ba6 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1367 microversion: 2.1 time: 0.173817 Aug 24 05:54:32.874766 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 479/952] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:32 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:33.896233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8edaf951-4ab2-44f6-bfd8-98e04a51a5a8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:33.896901 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8edaf951-4ab2-44f6-bfd8-98e04a51a5a8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:33.899282 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=6 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:33.904258 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8edaf951-4ab2-44f6-bfd8-98e04a51a5a8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:33.904787 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8edaf951-4ab2-44f6-bfd8-98e04a51a5a8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:33.905225 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8edaf951-4ab2-44f6-bfd8-98e04a51a5a8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:33.905932 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8edaf951-4ab2-44f6-bfd8-98e04a51a5a8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:33.906389 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8edaf951-4ab2-44f6-bfd8-98e04a51a5a8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:33.906814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8edaf951-4ab2-44f6-bfd8-98e04a51a5a8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:34.048149 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8edaf951-4ab2-44f6-bfd8-98e04a51a5a8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:34.056061 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8edaf951-4ab2-44f6-bfd8-98e04a51a5a8 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1367 microversion: 2.1 time: 0.164394 Aug 24 05:54:34.056657 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 474/953] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:33 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:34.453599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-d017c35b-fb04-4df6-8522-740da915db20 req-60740189-83bd-4c9d-a9fc-7979b018f7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02332736-ea71-45a8-b925-34196e98d20f", "name": "network-vif-plugged", "status": "completed", "tag": "ea01c152-11a1-41f8-89ca-aa117e6edb62"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:34.458786 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:34.459383 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=6 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:34.464975 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-d017c35b-fb04-4df6-8522-740da915db20 req-60740189-83bd-4c9d-a9fc-7979b018f7fb service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:34.465448 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-d017c35b-fb04-4df6-8522-740da915db20 req-60740189-83bd-4c9d-a9fc-7979b018f7fb service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:34.465870 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-d017c35b-fb04-4df6-8522-740da915db20 req-60740189-83bd-4c9d-a9fc-7979b018f7fb service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:34.476628 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-d017c35b-fb04-4df6-8522-740da915db20 req-60740189-83bd-4c9d-a9fc-7979b018f7fb service nova] Creating event network-vif-plugged:ea01c152-11a1-41f8-89ca-aa117e6edb62 for instance 02332736-ea71-45a8-b925-34196e98d20f on hv-cinder-85426 Aug 24 05:54:34.481551 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-d017c35b-fb04-4df6-8522-740da915db20 req-60740189-83bd-4c9d-a9fc-7979b018f7fb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031854 Aug 24 05:54:34.482121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 480/954] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:35.076815 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-575723f0-e891-4f35-b0fd-71a814e5d7ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:35.077437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-575723f0-e891-4f35-b0fd-71a814e5d7ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:35.084554 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-575723f0-e891-4f35-b0fd-71a814e5d7ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:35.085045 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-575723f0-e891-4f35-b0fd-71a814e5d7ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:35.085489 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-575723f0-e891-4f35-b0fd-71a814e5d7ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:35.086190 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-575723f0-e891-4f35-b0fd-71a814e5d7ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:35.086652 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-575723f0-e891-4f35-b0fd-71a814e5d7ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:35.087084 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-575723f0-e891-4f35-b0fd-71a814e5d7ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:35.221874 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-575723f0-e891-4f35-b0fd-71a814e5d7ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:35.230408 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-575723f0-e891-4f35-b0fd-71a814e5d7ec tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1367 microversion: 2.1 time: 0.157419 Aug 24 05:54:35.230985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 475/955] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:35 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:36.316345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6e2e7600-3779-47b8-9bee-27c2eeab0536 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:36.317137 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6e2e7600-3779-47b8-9bee-27c2eeab0536 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:36.323253 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e2e7600-3779-47b8-9bee-27c2eeab0536 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:36.323738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e2e7600-3779-47b8-9bee-27c2eeab0536 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:36.324173 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e2e7600-3779-47b8-9bee-27c2eeab0536 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:36.324897 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e2e7600-3779-47b8-9bee-27c2eeab0536 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:36.325352 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e2e7600-3779-47b8-9bee-27c2eeab0536 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:36.325773 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6e2e7600-3779-47b8-9bee-27c2eeab0536 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:36.464912 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6e2e7600-3779-47b8-9bee-27c2eeab0536 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:36.472254 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6e2e7600-3779-47b8-9bee-27c2eeab0536 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1367 microversion: 2.1 time: 0.223575 Aug 24 05:54:36.473381 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 481/956] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:36 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:37.494050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-19008ba4-6534-4e75-80ca-a39ca88f4bfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:37.494573 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-19008ba4-6534-4e75-80ca-a39ca88f4bfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:37.501060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-19008ba4-6534-4e75-80ca-a39ca88f4bfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:37.501547 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-19008ba4-6534-4e75-80ca-a39ca88f4bfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:37.501998 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-19008ba4-6534-4e75-80ca-a39ca88f4bfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:37.502689 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-19008ba4-6534-4e75-80ca-a39ca88f4bfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:37.503151 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-19008ba4-6534-4e75-80ca-a39ca88f4bfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:37.503960 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-19008ba4-6534-4e75-80ca-a39ca88f4bfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:37.633834 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-19008ba4-6534-4e75-80ca-a39ca88f4bfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:37.641705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-19008ba4-6534-4e75-80ca-a39ca88f4bfc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1558 microversion: 2.1 time: 0.151602 Aug 24 05:54:37.642274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 476/957] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:37 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:54:37.662283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8a7cfddd-31de-42e2-b2c1-bfec6040a2d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:37.662807 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8a7cfddd-31de-42e2-b2c1-bfec6040a2d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:37.669210 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a7cfddd-31de-42e2-b2c1-bfec6040a2d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:37.669688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a7cfddd-31de-42e2-b2c1-bfec6040a2d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:37.670121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a7cfddd-31de-42e2-b2c1-bfec6040a2d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:37.670804 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a7cfddd-31de-42e2-b2c1-bfec6040a2d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:37.671255 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a7cfddd-31de-42e2-b2c1-bfec6040a2d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:37.671686 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8a7cfddd-31de-42e2-b2c1-bfec6040a2d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:37.752829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8a7cfddd-31de-42e2-b2c1-bfec6040a2d3 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095121 Aug 24 05:54:37.753416 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 482/958] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 24 05:54:37 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:38.724707 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-7ad3b64d-45b5-4c4d-9136-2b61477376ca req-3d882ce1-4dfd-430e-aa6d-68dd6991edf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02332736-ea71-45a8-b925-34196e98d20f", "tag": "ea01c152-11a1-41f8-89ca-aa117e6edb62"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:38.734479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-7ad3b64d-45b5-4c4d-9136-2b61477376ca req-3d882ce1-4dfd-430e-aa6d-68dd6991edf7 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:38.734955 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-7ad3b64d-45b5-4c4d-9136-2b61477376ca req-3d882ce1-4dfd-430e-aa6d-68dd6991edf7 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:38.735387 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-7ad3b64d-45b5-4c4d-9136-2b61477376ca req-3d882ce1-4dfd-430e-aa6d-68dd6991edf7 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:38.746954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-7ad3b64d-45b5-4c4d-9136-2b61477376ca req-3d882ce1-4dfd-430e-aa6d-68dd6991edf7 service nova] Creating event network-changed:ea01c152-11a1-41f8-89ca-aa117e6edb62 for instance 02332736-ea71-45a8-b925-34196e98d20f on hv-cinder-85426 Aug 24 05:54:38.752176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-7ad3b64d-45b5-4c4d-9136-2b61477376ca req-3d882ce1-4dfd-430e-aa6d-68dd6991edf7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031382 Aug 24 05:54:38.753180 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 477/959] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:25.867601 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:25.868350 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=23 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:25.872303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e0852cb0-bcd2-4736-9df9-d8bd1e2913b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:25.872821 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e0852cb0-bcd2-4736-9df9-d8bd1e2913b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:25.878850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0852cb0-bcd2-4736-9df9-d8bd1e2913b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:25.887108 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0852cb0-bcd2-4736-9df9-d8bd1e2913b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:25.887108 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0852cb0-bcd2-4736-9df9-d8bd1e2913b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:25.887108 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0852cb0-bcd2-4736-9df9-d8bd1e2913b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:25.887108 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0852cb0-bcd2-4736-9df9-d8bd1e2913b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:25.887568 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0852cb0-bcd2-4736-9df9-d8bd1e2913b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:25.904083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e0852cb0-bcd2-4736-9df9-d8bd1e2913b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/ips" status: 200 len: 149 microversion: 2.20 time: 0.038152 Aug 24 05:55:25.904683 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 483/960] 10.222.0.15 () {60 vars in 1289 bytes} [Wed Aug 24 05:55:25 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:55:29.128967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-86075e76-1a26-469a-98f5-ca83a4b02299 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:29.129595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-86075e76-1a26-469a-98f5-ca83a4b02299 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:29.131971 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=11 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:29.132632 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:29.137562 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86075e76-1a26-469a-98f5-ca83a4b02299 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:29.138046 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86075e76-1a26-469a-98f5-ca83a4b02299 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:29.138480 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86075e76-1a26-469a-98f5-ca83a4b02299 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:29.139176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86075e76-1a26-469a-98f5-ca83a4b02299 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:29.139632 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86075e76-1a26-469a-98f5-ca83a4b02299 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:29.140058 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86075e76-1a26-469a-98f5-ca83a4b02299 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:29.164635 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-86075e76-1a26-469a-98f5-ca83a4b02299 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lazy-loading 'flavor' on Instance uuid a96fde59-06c5-4305-b87a-9fde71a07588 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:55:29.630501 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-86075e76-1a26-469a-98f5-ca83a4b02299 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "POST /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/action" status: 202 len: 0 microversion: 2.20 time: 0.505905 Aug 24 05:55:29.631135 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 478/961] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 24 05:55:29 2022] POST /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:55:29.639457 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:29.640101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:29.648376 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:29.648890 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:29.649327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:29.650029 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:29.650497 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:29.650920 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:29.793296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:29.802870 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:29.804504 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:29.805677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b27da813-bbb3-4228-a633-dc31c22f949f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.170232 Aug 24 05:55:29.806221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 484/962] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:29 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:30.831208 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:30.831902 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:30.838176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:30.838660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:30.839099 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:30.839781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:30.840242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:30.840696 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:30.978194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:30.987172 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:30.989118 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:30.990275 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d2e660b9-3b5f-4655-9568-141d471c90d2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.164450 Aug 24 05:55:30.990834 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 479/963] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:30 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:32.014658 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:32.015264 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:32.022618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:32.023105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:32.023545 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:32.024240 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:32.024728 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:32.025177 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:32.159348 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:32.167872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:32.169453 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:32.170606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-be5245f1-2e2f-4c87-94d3-d4ed072df2c9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.159970 Aug 24 05:55:32.171162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 485/964] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:32 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:33.195194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:33.195845 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:33.202481 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:33.202964 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:33.203404 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:33.204097 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:33.204602 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:33.205712 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:33.337036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:33.345165 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:33.346851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:33.348006 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-69e0a6f7-3ab6-430c-9911-63944b134cb7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.157098 Aug 24 05:55:33.348588 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 480/965] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:33 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:34.370895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:34.371532 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:34.378656 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:34.379135 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:34.379572 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:34.380251 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:34.380749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:34.381172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:34.511945 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:34.520061 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:34.521598 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:34.522740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c10ac23b-906b-4e89-a79f-a6f7411a606e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.155789 Aug 24 05:55:34.523295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 486/966] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:34 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:35.545625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:35.546254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:35.552997 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:35.553473 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:35.553913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:35.554593 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:35.555044 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:35.555488 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:35.687846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:35.697296 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:35.698854 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:35.700020 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-626fc6b1-aae8-40c8-b850-c60a66a89e35 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.158519 Aug 24 05:55:35.700841 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 481/967] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:35 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:36.724718 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:36.725337 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:36.731833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:36.732320 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:36.732798 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:36.733510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:36.733951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:36.734377 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:36.863093 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:36.871430 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:36.872990 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:36.874154 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a66b0c72-f978-418f-a513-d33ebf18eebc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.154092 Aug 24 05:55:36.874716 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 487/968] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:36 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:37.897553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:37.898164 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:37.904567 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:37.905052 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:37.905594 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:37.906284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:37.906745 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:37.907166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:38.036365 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:38.044756 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:38.046337 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:38.047461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-205e6d56-c7ac-44ee-a96a-d47881e9c7fd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.153843 Aug 24 05:55:38.048014 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 482/969] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:37 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:39.070395 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:39.070999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:39.077537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:39.078016 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:39.078483 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:39.079186 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:39.079643 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:39.080140 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:39.211602 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:39.219706 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:39.221858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:39.223019 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-99357905-87a5-4596-bf8e-a51320c670cf tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.156639 Aug 24 05:55:39.223570 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 488/970] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:39 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:40.246614 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:40.247224 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:40.254416 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:40.254898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:40.255341 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:40.256034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:40.256523 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:40.256952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:40.404480 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:40.415427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:40.416959 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:40.418117 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c56a277e-6312-400b-b2b1-ed48e28e1b71 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.175479 Aug 24 05:55:40.418980 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 483/971] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:40 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:41.447219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:41.447792 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:41.454503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:41.454992 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:41.455442 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:41.456168 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:41.457202 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:41.457670 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:41.591976 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:41.601153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:41.602666 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:41.603822 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-10bfd6a0-523c-472a-ad25-9455ad19888e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.160601 Aug 24 05:55:41.604383 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 489/972] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:41 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:42.627891 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:42.636178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:42.636837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:42.637339 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:42.637792 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:42.638507 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:42.638970 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:42.639461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:42.778211 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:42.788801 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:42.789351 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:42.790491 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-13e9d5e4-ad2c-457e-9c07-b4a5169d6549 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1742 microversion: 2.20 time: 0.167033 Aug 24 05:55:42.791383 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 484/973] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:42 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:43.814529 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:43.815126 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:43.822240 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:43.822724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:43.823163 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:43.823852 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:43.824304 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:43.824755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:43.959081 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:43.967191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:43.968727 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:43.969891 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0fe6316b-446b-4c51-99c7-019ffec191f5 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1742 microversion: 2.20 time: 0.159327 Aug 24 05:55:43.970449 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 490/974] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:43 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:44.854458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-5706b3bb-0bc4-4c27-ad73-c0c8ca499d82 req-1249c9e9-3e69-47e3-a00a-7374f0db8a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96fde59-06c5-4305-b87a-9fde71a07588", "name": "network-vif-plugged", "status": "completed", "tag": "d949a0c9-9094-4077-9a1f-391953b800d1"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:44.864046 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5706b3bb-0bc4-4c27-ad73-c0c8ca499d82 req-1249c9e9-3e69-47e3-a00a-7374f0db8a3c service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:44.864890 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5706b3bb-0bc4-4c27-ad73-c0c8ca499d82 req-1249c9e9-3e69-47e3-a00a-7374f0db8a3c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:44.865069 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5706b3bb-0bc4-4c27-ad73-c0c8ca499d82 req-1249c9e9-3e69-47e3-a00a-7374f0db8a3c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:44.993784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:44.994399 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:45.001216 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:45.001705 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:45.002138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:45.002833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:45.003286 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:45.003701 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:45.025563 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-5706b3bb-0bc4-4c27-ad73-c0c8ca499d82 req-1249c9e9-3e69-47e3-a00a-7374f0db8a3c service nova] Creating event network-vif-plugged:d949a0c9-9094-4077-9a1f-391953b800d1 for instance a96fde59-06c5-4305-b87a-9fde71a07588 on hv-cinder-85426 Aug 24 05:55:45.030661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-5706b3bb-0bc4-4c27-ad73-c0c8ca499d82 req-1249c9e9-3e69-47e3-a00a-7374f0db8a3c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239834 Aug 24 05:55:45.036877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 485/975] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:45.139662 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:45.148801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:45.150283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:45.151414 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-91f182f1-164b-4d1d-9695-3e9a63f5465f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1742 microversion: 2.20 time: 0.161745 Aug 24 05:55:45.151974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 491/976] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:44 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:55:46.175478 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:46.176943 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:46.183379 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:46.183876 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:46.184313 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:46.185049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:46.185508 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:46.185934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:46.321855 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:46.330176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:46.331679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:46.333439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-52d552fc-c558-4530-886e-57ce87bfeb43 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1742 microversion: 2.20 time: 0.163084 Aug 24 05:55:46.333946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 486/977] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:46 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:47.356884 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:47.357493 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:47.363755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:47.365543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:47.366007 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:47.366725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:47.367186 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:47.367614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:47.501693 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:47.510747 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:47.512261 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:47.513565 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6a8558b8-8504-407f-93d4-2c23d26f73f2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1742 microversion: 2.20 time: 0.160537 Aug 24 05:55:47.514129 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 492/978] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:47 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:47.985688 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2a46019d-f9ae-48be-a2b8-749fd8ac1824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:47.986262 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2a46019d-f9ae-48be-a2b8-749fd8ac1824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:47.993335 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a46019d-f9ae-48be-a2b8-749fd8ac1824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:47.993820 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a46019d-f9ae-48be-a2b8-749fd8ac1824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:47.994263 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a46019d-f9ae-48be-a2b8-749fd8ac1824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:47.994966 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a46019d-f9ae-48be-a2b8-749fd8ac1824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:47.995428 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a46019d-f9ae-48be-a2b8-749fd8ac1824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:47.995859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2a46019d-f9ae-48be-a2b8-749fd8ac1824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:48.020008 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2a46019d-f9ae-48be-a2b8-749fd8ac1824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/ips" status: 200 len: 145 microversion: 2.1 time: 0.038194 Aug 24 05:55:48.021803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 487/979] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 24 05:55:47 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:48.537090 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:48.537633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:48.544120 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:48.544628 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:48.545064 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:48.545741 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:48.546189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:48.546605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:48.673176 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:48.682348 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:48.683855 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:48.685128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2194c124-8043-43d9-a837-b5544c5d7d85 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1742 microversion: 2.20 time: 0.152087 Aug 24 05:55:48.685683 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 493/980] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:48 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:49.709558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:49.710177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:49.716639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:49.717127 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:49.717571 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:49.718272 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:49.718773 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:49.719207 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:49.862553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:49.871455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:49.873002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:49.874158 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f9b6da6e-4d52-415e-8c21-cfd123a76c8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1742 microversion: 2.20 time: 0.169736 Aug 24 05:55:49.874706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 488/981] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:49 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:50.898619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:50.899214 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:50.905782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:50.906266 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:50.906706 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:50.907400 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:50.907859 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:50.908283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:51.040699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:51.049360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:51.050851 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:51.053138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c8fd02e0-bc93-439f-bd7f-42fb80a36cd1 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1742 microversion: 2.20 time: 0.158275 Aug 24 05:55:51.053330 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 494/982] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:50 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:52.076026 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:52.076681 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:52.083329 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:52.083817 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:52.085473 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:52.086186 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:52.086652 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:52.087088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:52.217294 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:52.225402 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:52.226904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:52.228058 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d7a4fb6c-35e2-4557-8e0b-6a5e9110f780 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1742 microversion: 2.20 time: 0.156083 Aug 24 05:55:52.228632 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 489/983] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:52 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:53.251380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:53.251848 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:53.258801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:53.259265 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:53.259705 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:53.260384 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:53.260853 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:53.261272 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:53.394851 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:53.403371 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:53.404902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:53.406084 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ff0ecaad-5007-42c4-ac99-258b435564b9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1742 microversion: 2.20 time: 0.158772 Aug 24 05:55:53.406628 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 495/984] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:53 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:55:54.429502 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:54.430107 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:54.437255 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:54.437743 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:54.438185 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:54.438919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:54.439384 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:54.439800 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:54.574433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:54.582651 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:54.584339 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:54.585547 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8c8e2af4-244c-47d5-a461-b677318763a8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1742 microversion: 2.20 time: 0.160076 Aug 24 05:55:54.586274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 490/985] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:54 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:55:55.293963 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-75035ebe-27b6-436f-956b-a840da478ad2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9db6c80-01d1-48f1-a071-1016fa6c3866"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:55.296614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-75035ebe-27b6-436f-956b-a840da478ad2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:55.303757 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-75035ebe-27b6-436f-956b-a840da478ad2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:55.304177 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-75035ebe-27b6-436f-956b-a840da478ad2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:55.304641 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-75035ebe-27b6-436f-956b-a840da478ad2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:55.305334 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-75035ebe-27b6-436f-956b-a840da478ad2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:55.306139 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-75035ebe-27b6-436f-956b-a840da478ad2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:55.306562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-75035ebe-27b6-436f-956b-a840da478ad2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:55.609626 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:55.610685 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:55.618522 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:55.619067 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:55.619495 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:55.620612 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:55.621909 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:55.622358 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:55.789330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:55.804883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:55.807405 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:55.808743 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-26392b0e-26a1-4b9c-bf86-f64af5438821 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.203486 Aug 24 05:55:55.809683 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 491/986] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:55 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:55:56.205919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-75035ebe-27b6-436f-956b-a840da478ad2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "POST /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.916417 Aug 24 05:55:56.206540 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 496/987] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 05:55:55 2022] POST /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/os-volume_attachments => generated 194 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:56.834156 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:56.834715 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:56.842297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:56.842795 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:56.843259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:56.843956 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:56.844612 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:56.845037 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:56.985180 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:56.993480 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:56.995524 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:56.996782 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-48ff3e97-ba3c-4e76-a403-0177ad8fe68b tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.166705 Aug 24 05:55:56.997334 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 492/988] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:56 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:58.022060 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:58.022752 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:58.030491 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:58.031219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:58.031845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:58.032759 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:58.033380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:58.033992 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:58.179294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:58.188584 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:58.190141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:58.191547 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-47aca163-fb9f-46ad-a51a-c79690e58577 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.174456 Aug 24 05:55:58.192271 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 497/989] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:58 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:55:59.214718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:59.215326 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:59.217757 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=31 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:59.222561 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:59.223043 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:59.223478 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:59.224206 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:59.224687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:59.225114 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:59.245347 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:59.365924 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:59.374687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:59.376178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:59.377383 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-362cb422-d34b-48ec-9eec-66e681ae2353 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.166907 Aug 24 05:55:59.378174 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 493/990] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:55:59 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:00.401014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:00.401627 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:00.410558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=31 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:00.410558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:00.410558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:00.410558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:00.410977 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:00.411062 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:00.411451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:00.414148 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:00.547375 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:00.557133 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:00.558727 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:00.559893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d3d30f57-e10f-411e-bf14-db1486ce019d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.162939 Aug 24 05:56:00.560461 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 498/991] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:00 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:01.583377 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:01.584624 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:01.599610 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:01.600476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:01.603006 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:01.605466 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:01.606311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:01.606994 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:01.740452 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1961913288", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1642854592", "security_groups": [{"name": "tempest-secgroup-smoke-152603612"}], "block_device_mapping_v2": [{"uuid": "66e5db16-97bb-44dd-86d3-2e466c60ef09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f65f9f7a-ac88-464d-85df-73c9c53a7e50"}]}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:01.775349 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:01.790840 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:01.792705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:01.794290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d7971f45-e05d-4ed6-8327-2c89f9b51759 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.214805 Aug 24 05:56:01.795177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 494/992] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:01 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:01.885459 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.network.neutron [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] validate_networks() for [('f65f9f7a-ac88-464d-85df-73c9c53a7e50', None, None, None, None, None)] {{(pid=127756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:56:02.310448 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Flavor limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:56:02.310898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Image limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:56:02.311373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Flavor pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:56:02.311781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Image pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:56:02.312192 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:56:02.322570 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:02.323481 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:02.323954 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:02.324955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:02.325652 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:02.326321 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:02.346133 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Getting quotas for project 8e8dbc250d3447ecbd8c7b6df2d10d2c. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:56:02.350950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Getting quotas for user b92925514b544fbe9e34326f9c48cb24 and project 8e8dbc250d3447ecbd8c7b6df2d10d2c. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:56:02.438722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Going to run 1 instances... {{(pid=127756) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:56:02.440873 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66e5db16-97bb-44dd-86d3-2e466c60ef09',volume_size=None,volume_type=None)] {{(pid=127756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:56:02.822156 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:02.822772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:02.830382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:02.831029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:02.834430 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c004fff5-07ce-4e6f-b6d8-97fa5a46a421 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.099688 Aug 24 05:56:02.838929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 499/993] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:56:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 05:56:02.842868 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:02.843742 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:02.844297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:02.844731 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:02.854260 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9916261a-2b31-4cef-a0f3-103d8398ceb1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:02.854883 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9916261a-2b31-4cef-a0f3-103d8398ceb1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:02.979228 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9916261a-2b31-4cef-a0f3-103d8398ceb1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:02.988486 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9916261a-2b31-4cef-a0f3-103d8398ceb1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1095 microversion: 2.1 time: 0.138669 Aug 24 05:56:02.990370 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 500/994] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:02 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1095 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:03.378744 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:03.389022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:03.390918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:03.392422 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1ac5aa11-7b62-4623-bb38-de5c32986865 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.574810 Aug 24 05:56:03.393085 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 495/995] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:02 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:04.016634 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ba03f308-b6e5-4b25-af4c-34899da3cd39 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:04.018697 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ba03f308-b6e5-4b25-af4c-34899da3cd39 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:04.030006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba03f308-b6e5-4b25-af4c-34899da3cd39 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:04.031141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba03f308-b6e5-4b25-af4c-34899da3cd39 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:04.032128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba03f308-b6e5-4b25-af4c-34899da3cd39 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:04.033523 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba03f308-b6e5-4b25-af4c-34899da3cd39 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:04.034284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba03f308-b6e5-4b25-af4c-34899da3cd39 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:04.035080 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ba03f308-b6e5-4b25-af4c-34899da3cd39 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:04.138951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ba03f308-b6e5-4b25-af4c-34899da3cd39 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:04.146875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ba03f308-b6e5-4b25-af4c-34899da3cd39 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1145 microversion: 2.1 time: 0.137756 Aug 24 05:56:04.147471 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 501/996] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:04 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1145 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:04.417411 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:04.418608 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:04.425508 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:04.425999 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:04.426444 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:04.427143 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:04.427608 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:04.428044 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:04.565462 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:04.574901 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:04.576475 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:04.577712 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-fb5e16df-746b-4636-9e23-fd900bdd4cfd tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.164973 Aug 24 05:56:04.578264 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 496/997] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:04 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:05.169741 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ef7a0ef0-a5e2-453e-98c1-b542520c5171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:05.170564 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ef7a0ef0-a5e2-453e-98c1-b542520c5171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:05.183218 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef7a0ef0-a5e2-453e-98c1-b542520c5171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:05.183723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef7a0ef0-a5e2-453e-98c1-b542520c5171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:05.184173 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef7a0ef0-a5e2-453e-98c1-b542520c5171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:05.186728 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef7a0ef0-a5e2-453e-98c1-b542520c5171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:05.186728 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef7a0ef0-a5e2-453e-98c1-b542520c5171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:05.186728 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ef7a0ef0-a5e2-453e-98c1-b542520c5171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:05.261287 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ef7a0ef0-a5e2-453e-98c1-b542520c5171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:05.269869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ef7a0ef0-a5e2-453e-98c1-b542520c5171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1193 microversion: 2.1 time: 0.104069 Aug 24 05:56:05.270736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 502/998] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:05 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1193 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:05.603605 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:05.604247 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:05.611129 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:05.611625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:05.612074 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:05.612830 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:05.613282 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:05.613713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:05.755163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:05.763835 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:05.765363 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:05.766524 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-01c07701-490c-407b-afce-3266aa064652 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.168490 Aug 24 05:56:05.767077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 497/999] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:05 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:06.291319 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-cb38b083-ce38-4b77-8c08-333b99d4ce64 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:06.292544 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-cb38b083-ce38-4b77-8c08-333b99d4ce64 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:06.306362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb38b083-ce38-4b77-8c08-333b99d4ce64 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:06.306869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb38b083-ce38-4b77-8c08-333b99d4ce64 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:06.307366 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb38b083-ce38-4b77-8c08-333b99d4ce64 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:06.308077 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb38b083-ce38-4b77-8c08-333b99d4ce64 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:06.308725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb38b083-ce38-4b77-8c08-333b99d4ce64 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:06.309317 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cb38b083-ce38-4b77-8c08-333b99d4ce64 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:06.483802 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cb38b083-ce38-4b77-8c08-333b99d4ce64 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:06.494484 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-cb38b083-ce38-4b77-8c08-333b99d4ce64 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1278 microversion: 2.1 time: 0.206314 Aug 24 05:56:06.495998 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 503/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:06 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:06.790807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:06.791538 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:06.798213 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:06.799049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:06.799492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:06.800192 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:06.800760 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:06.801188 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:06.947552 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:06.956353 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:06.958303 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:06.959520 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8ca6761a-4d24-4fb2-9346-8fea9c829a6f tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.173389 Aug 24 05:56:06.960081 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 498/1001] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:06 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:07.516984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c784b408-16ae-4753-8a4d-bc4769526758 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:07.518205 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c784b408-16ae-4753-8a4d-bc4769526758 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:07.527201 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c784b408-16ae-4753-8a4d-bc4769526758 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:07.531043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c784b408-16ae-4753-8a4d-bc4769526758 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:07.531043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c784b408-16ae-4753-8a4d-bc4769526758 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:07.531043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c784b408-16ae-4753-8a4d-bc4769526758 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:07.531043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c784b408-16ae-4753-8a4d-bc4769526758 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:07.531439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c784b408-16ae-4753-8a4d-bc4769526758 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:07.683617 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c784b408-16ae-4753-8a4d-bc4769526758 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:07.692666 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c784b408-16ae-4753-8a4d-bc4769526758 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1278 microversion: 2.1 time: 0.181214 Aug 24 05:56:07.693920 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 504/1002] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:07 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:07.983358 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:07.983967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:07.992855 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:07.994528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:07.994979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:07.995693 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:07.996156 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:07.997632 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:08.162732 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:08.173382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:08.175378 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:08.177017 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c6e15460-04dd-4630-99b6-70bd4a2200b4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.198168 Aug 24 05:56:08.178183 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 499/1003] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:07 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:08.205369 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-426f8b44-8671-4e09-bd5b-e1dc39da27b1 req-7501c7fc-c5f2-4d04-ae28-e8bc9c406156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930020e6-49a9-488f-870a-1da855b88720", "tag": "05efbf18-2e2f-490b-b7d8-fda19d6de7d8"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:08.215629 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-426f8b44-8671-4e09-bd5b-e1dc39da27b1 req-7501c7fc-c5f2-4d04-ae28-e8bc9c406156 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:08.216113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-426f8b44-8671-4e09-bd5b-e1dc39da27b1 req-7501c7fc-c5f2-4d04-ae28-e8bc9c406156 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:08.216594 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-426f8b44-8671-4e09-bd5b-e1dc39da27b1 req-7501c7fc-c5f2-4d04-ae28-e8bc9c406156 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:08.235418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-426f8b44-8671-4e09-bd5b-e1dc39da27b1 req-7501c7fc-c5f2-4d04-ae28-e8bc9c406156 service nova] Creating event network-changed:05efbf18-2e2f-490b-b7d8-fda19d6de7d8 for instance 930020e6-49a9-488f-870a-1da855b88720 on hv-cinder-85426 Aug 24 05:56:08.240996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-426f8b44-8671-4e09-bd5b-e1dc39da27b1 req-7501c7fc-c5f2-4d04-ae28-e8bc9c406156 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143940 Aug 24 05:56:08.241973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 505/1004] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:08.716587 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-234a614d-aeab-4676-a248-5ab6563d9001 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:08.717564 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-234a614d-aeab-4676-a248-5ab6563d9001 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:08.731420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-234a614d-aeab-4676-a248-5ab6563d9001 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:08.732251 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-234a614d-aeab-4676-a248-5ab6563d9001 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:08.732931 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-234a614d-aeab-4676-a248-5ab6563d9001 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:08.733906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-234a614d-aeab-4676-a248-5ab6563d9001 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:08.734444 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-234a614d-aeab-4676-a248-5ab6563d9001 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:08.735098 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-234a614d-aeab-4676-a248-5ab6563d9001 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:08.914641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-234a614d-aeab-4676-a248-5ab6563d9001 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:08.931717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-234a614d-aeab-4676-a248-5ab6563d9001 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1278 microversion: 2.1 time: 0.220494 Aug 24 05:56:08.940728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 500/1005] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:08 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:09.207052 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:09.207710 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:09.208326 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e0bca610-3668-46fe-af07-dd7b57069616 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:09.217081 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0bca610-3668-46fe-af07-dd7b57069616 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:09.217654 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:09.217898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0bca610-3668-46fe-af07-dd7b57069616 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:09.218147 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:09.218339 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e0bca610-3668-46fe-af07-dd7b57069616 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:09.218584 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:09.219290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:09.219748 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:09.220171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:09.291553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e0bca610-3668-46fe-af07-dd7b57069616 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Going to try to stop instance {{(pid=127756) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 05:56:09.379097 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:09.388680 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:09.390356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:09.391526 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-5306942e-c2e0-4c66-9f2e-30498fad5abb tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.188556 Aug 24 05:56:09.392069 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 501/1006] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:09 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:09.839457 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e0bca610-3668-46fe-af07-dd7b57069616 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "POST /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/action" status: 202 len: 0 microversion: 2.1 time: 0.637103 Aug 24 05:56:09.840231 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 506/1007] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:56:09 2022] POST /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:56:09.849118 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-90aa21cc-1561-46c8-84a4-77916440a368 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:09.849788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-90aa21cc-1561-46c8-84a4-77916440a368 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:09.856371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-90aa21cc-1561-46c8-84a4-77916440a368 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:09.856895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-90aa21cc-1561-46c8-84a4-77916440a368 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:09.857673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-90aa21cc-1561-46c8-84a4-77916440a368 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:09.858036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-90aa21cc-1561-46c8-84a4-77916440a368 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:09.858492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-90aa21cc-1561-46c8-84a4-77916440a368 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:09.858919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-90aa21cc-1561-46c8-84a4-77916440a368 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:09.963898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-352033a9-aec9-4011-8ed2-cc3748cdff59 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:09.964674 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-352033a9-aec9-4011-8ed2-cc3748cdff59 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:09.971342 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-352033a9-aec9-4011-8ed2-cc3748cdff59 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:09.971840 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-352033a9-aec9-4011-8ed2-cc3748cdff59 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:09.972278 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-352033a9-aec9-4011-8ed2-cc3748cdff59 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:09.973050 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-352033a9-aec9-4011-8ed2-cc3748cdff59 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:09.973513 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-352033a9-aec9-4011-8ed2-cc3748cdff59 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:09.973939 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-352033a9-aec9-4011-8ed2-cc3748cdff59 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:09.997561 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-90aa21cc-1561-46c8-84a4-77916440a368 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:10.006414 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-90aa21cc-1561-46c8-84a4-77916440a368 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.161302 Aug 24 05:56:10.007277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 502/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:09 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:10.114236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-352033a9-aec9-4011-8ed2-cc3748cdff59 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:10.122695 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-352033a9-aec9-4011-8ed2-cc3748cdff59 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1278 microversion: 2.1 time: 0.163309 Aug 24 05:56:10.123572 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 507/1009] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:09 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:10.433952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:10.434849 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:10.455967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:10.457371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:10.458213 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:10.460796 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:10.460796 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:10.462028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:10.636251 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:10.652157 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:10.654241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:10.655775 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-04352d3e-e0ce-48c9-85d8-5e18e41054ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.228260 Aug 24 05:56:10.656899 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 503/1010] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:10 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:11.027661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a7e90a33-0f99-4235-8257-b8e9c8630683 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:11.028271 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a7e90a33-0f99-4235-8257-b8e9c8630683 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:11.035876 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e90a33-0f99-4235-8257-b8e9c8630683 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:11.036471 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e90a33-0f99-4235-8257-b8e9c8630683 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:11.038603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e90a33-0f99-4235-8257-b8e9c8630683 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:11.039968 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e90a33-0f99-4235-8257-b8e9c8630683 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:11.040473 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e90a33-0f99-4235-8257-b8e9c8630683 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:11.040916 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e90a33-0f99-4235-8257-b8e9c8630683 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:11.176713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-78967723-f767-4a35-a41a-3c557ac9d8ce tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:11.176713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-78967723-f767-4a35-a41a-3c557ac9d8ce tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:11.176713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78967723-f767-4a35-a41a-3c557ac9d8ce tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:11.176713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78967723-f767-4a35-a41a-3c557ac9d8ce tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:11.177771 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78967723-f767-4a35-a41a-3c557ac9d8ce tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:11.177771 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78967723-f767-4a35-a41a-3c557ac9d8ce tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:11.177771 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78967723-f767-4a35-a41a-3c557ac9d8ce tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:11.177771 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78967723-f767-4a35-a41a-3c557ac9d8ce tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:11.197647 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a7e90a33-0f99-4235-8257-b8e9c8630683 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:11.212335 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a7e90a33-0f99-4235-8257-b8e9c8630683 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.188128 Aug 24 05:56:11.232212 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 508/1011] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:11 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:11.325315 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-78967723-f767-4a35-a41a-3c557ac9d8ce tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:11.333192 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-78967723-f767-4a35-a41a-3c557ac9d8ce tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.193835 Aug 24 05:56:11.336505 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 504/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:11 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:11.682392 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:11.683001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:11.689147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:11.689654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:11.690092 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:11.690782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:11.691237 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:11.691658 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:11.825725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:11.834018 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:11.835527 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:11.837390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6148892f-080f-40ba-93ae-345ac378b8d7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.159882 Aug 24 05:56:11.837975 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 509/1013] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:11 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:12.238026 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-36e255fd-ca96-4f21-bdd6-2070e86756ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:12.238648 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-36e255fd-ca96-4f21-bdd6-2070e86756ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:12.245322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-36e255fd-ca96-4f21-bdd6-2070e86756ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:12.245811 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-36e255fd-ca96-4f21-bdd6-2070e86756ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:12.246255 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-36e255fd-ca96-4f21-bdd6-2070e86756ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:12.246954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-36e255fd-ca96-4f21-bdd6-2070e86756ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:12.247416 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-36e255fd-ca96-4f21-bdd6-2070e86756ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:12.247852 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-36e255fd-ca96-4f21-bdd6-2070e86756ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:12.357654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-109d3964-ba72-4e9a-8413-4cc502a7d968 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:12.358265 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-109d3964-ba72-4e9a-8413-4cc502a7d968 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:12.361750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:12.365283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-109d3964-ba72-4e9a-8413-4cc502a7d968 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:12.365773 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-109d3964-ba72-4e9a-8413-4cc502a7d968 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:12.366222 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-109d3964-ba72-4e9a-8413-4cc502a7d968 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:12.366925 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-109d3964-ba72-4e9a-8413-4cc502a7d968 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:12.368070 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-109d3964-ba72-4e9a-8413-4cc502a7d968 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:12.369127 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-109d3964-ba72-4e9a-8413-4cc502a7d968 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:12.384350 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-36e255fd-ca96-4f21-bdd6-2070e86756ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:12.392669 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-36e255fd-ca96-4f21-bdd6-2070e86756ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.158466 Aug 24 05:56:12.393253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 505/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:12 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:12.513928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-109d3964-ba72-4e9a-8413-4cc502a7d968 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:12.521600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-109d3964-ba72-4e9a-8413-4cc502a7d968 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.167796 Aug 24 05:56:12.522161 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 510/1015] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:12 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:12.861134 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:12.861660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:12.868654 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:12.869141 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:12.869582 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:12.870308 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:12.870768 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:12.871241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:13.002197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:13.010826 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:13.012325 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:13.013512 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9e155518-b2c6-4a6b-a6aa-07e5d758ae58 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1737 microversion: 2.20 time: 0.156972 Aug 24 05:56:13.014066 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 506/1016] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:12 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:13.415697 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0841937b-5b05-49c3-96a3-015065f06bc9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:13.416987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0841937b-5b05-49c3-96a3-015065f06bc9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:13.419031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=8 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:13.424820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0841937b-5b05-49c3-96a3-015065f06bc9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:13.425512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0841937b-5b05-49c3-96a3-015065f06bc9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:13.425852 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0841937b-5b05-49c3-96a3-015065f06bc9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:13.426550 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0841937b-5b05-49c3-96a3-015065f06bc9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:13.427006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0841937b-5b05-49c3-96a3-015065f06bc9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:13.427427 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0841937b-5b05-49c3-96a3-015065f06bc9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:13.542832 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2c7635f4-fe17-4b33-8143-b784d1bd036b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:13.544209 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2c7635f4-fe17-4b33-8143-b784d1bd036b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:13.551822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7635f4-fe17-4b33-8143-b784d1bd036b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:13.552315 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7635f4-fe17-4b33-8143-b784d1bd036b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:13.552846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7635f4-fe17-4b33-8143-b784d1bd036b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:13.554012 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7635f4-fe17-4b33-8143-b784d1bd036b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:13.554855 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7635f4-fe17-4b33-8143-b784d1bd036b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:13.555297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2c7635f4-fe17-4b33-8143-b784d1bd036b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:13.563390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0841937b-5b05-49c3-96a3-015065f06bc9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:13.572711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0841937b-5b05-49c3-96a3-015065f06bc9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.162262 Aug 24 05:56:13.573525 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 511/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:13 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:13.694471 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2c7635f4-fe17-4b33-8143-b784d1bd036b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:13.702640 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2c7635f4-fe17-4b33-8143-b784d1bd036b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.163756 Aug 24 05:56:13.703193 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 507/1018] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:13 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:14.036447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:14.036982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:14.043634 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:14.044120 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:14.044599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:14.045295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:14.045755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:14.046182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:14.182640 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:14.190847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:14.192460 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:14.193604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b2fb7ccd-24dd-4109-bea7-3a4ab7d401a2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1719 microversion: 2.20 time: 0.161186 Aug 24 05:56:14.194154 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 512/1019] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:14 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:14.593678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a4f63c6f-db57-43ce-87a1-a55c50b7d1dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:14.594276 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a4f63c6f-db57-43ce-87a1-a55c50b7d1dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:14.600770 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a4f63c6f-db57-43ce-87a1-a55c50b7d1dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:14.601257 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a4f63c6f-db57-43ce-87a1-a55c50b7d1dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:14.602378 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a4f63c6f-db57-43ce-87a1-a55c50b7d1dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:14.603041 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a4f63c6f-db57-43ce-87a1-a55c50b7d1dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:14.603501 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a4f63c6f-db57-43ce-87a1-a55c50b7d1dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:14.603932 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a4f63c6f-db57-43ce-87a1-a55c50b7d1dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:14.723085 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a9f61950-c778-4438-9888-c9fd2cb0bbc6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:14.723813 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a9f61950-c778-4438-9888-c9fd2cb0bbc6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:14.731093 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f61950-c778-4438-9888-c9fd2cb0bbc6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:14.731576 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f61950-c778-4438-9888-c9fd2cb0bbc6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:14.732018 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f61950-c778-4438-9888-c9fd2cb0bbc6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:14.732566 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a4f63c6f-db57-43ce-87a1-a55c50b7d1dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:14.732740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f61950-c778-4438-9888-c9fd2cb0bbc6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:14.733189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f61950-c778-4438-9888-c9fd2cb0bbc6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:14.733605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9f61950-c778-4438-9888-c9fd2cb0bbc6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:14.741050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a4f63c6f-db57-43ce-87a1-a55c50b7d1dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.151259 Aug 24 05:56:14.741701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 508/1020] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:14 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:14.862678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a9f61950-c778-4438-9888-c9fd2cb0bbc6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:14.871047 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a9f61950-c778-4438-9888-c9fd2cb0bbc6 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.151841 Aug 24 05:56:14.871606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 513/1021] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:14 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:15.217461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:15.218079 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:15.224099 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:15.224636 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:15.225089 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:15.225787 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:15.226249 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:15.227245 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:15.361346 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:15.369918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:15.371431 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:15.372613 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4af03f4a-4578-4da2-9d94-e2d27f2e0898 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1719 microversion: 2.20 time: 0.159208 Aug 24 05:56:15.373172 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 509/1022] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:15 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:15.762740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c26aa870-1b7e-41f9-ab31-41d170da0054 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:15.763358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c26aa870-1b7e-41f9-ab31-41d170da0054 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:15.769947 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c26aa870-1b7e-41f9-ab31-41d170da0054 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:15.770431 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c26aa870-1b7e-41f9-ab31-41d170da0054 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:15.770872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c26aa870-1b7e-41f9-ab31-41d170da0054 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:15.771563 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c26aa870-1b7e-41f9-ab31-41d170da0054 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:15.772024 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c26aa870-1b7e-41f9-ab31-41d170da0054 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:15.772477 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c26aa870-1b7e-41f9-ab31-41d170da0054 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:15.891873 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-5d995285-c085-465c-be78-793e795d5f5f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:15.897317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5d995285-c085-465c-be78-793e795d5f5f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:15.899017 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d995285-c085-465c-be78-793e795d5f5f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:15.899508 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d995285-c085-465c-be78-793e795d5f5f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:15.899929 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d995285-c085-465c-be78-793e795d5f5f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:15.900658 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d995285-c085-465c-be78-793e795d5f5f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:15.901110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d995285-c085-465c-be78-793e795d5f5f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:15.901531 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5d995285-c085-465c-be78-793e795d5f5f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:15.902419 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c26aa870-1b7e-41f9-ab31-41d170da0054 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:15.905777 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:15.911184 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c26aa870-1b7e-41f9-ab31-41d170da0054 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.152927 Aug 24 05:56:15.911830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 514/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:15 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:16.038803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5d995285-c085-465c-be78-793e795d5f5f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:16.047792 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-5d995285-c085-465c-be78-793e795d5f5f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.159957 Aug 24 05:56:16.048363 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 510/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:15 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:16.396286 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:16.396921 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:16.403392 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:16.403872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:16.404309 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:16.405065 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:16.405526 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:16.405951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:16.540867 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:16.549251 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:16.550750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:16.551915 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ec95b706-0714-4e76-b59c-9f706076df3c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1722 microversion: 2.20 time: 0.159658 Aug 24 05:56:16.552479 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 515/1025] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:16 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:16.574176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-24699018-bd25-4272-b4db-165e58bc35f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76604968-14b6-4106-897c-cabdcd16c0f8"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:16.576643 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-24699018-bd25-4272-b4db-165e58bc35f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:16.582581 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24699018-bd25-4272-b4db-165e58bc35f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:16.583054 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24699018-bd25-4272-b4db-165e58bc35f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:16.583482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24699018-bd25-4272-b4db-165e58bc35f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:16.584166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24699018-bd25-4272-b4db-165e58bc35f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:16.584657 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24699018-bd25-4272-b4db-165e58bc35f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:16.585075 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24699018-bd25-4272-b4db-165e58bc35f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:16.877525 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-fcba39ce-994f-469b-b23a-1521ee9425b7 req-9b14d8b9-5f8e-4b2a-9e2d-ce73b191c741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96fde59-06c5-4305-b87a-9fde71a07588", "name": "network-vif-unplugged", "status": "completed", "tag": "d949a0c9-9094-4077-9a1f-391953b800d1"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:16.891333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-fcba39ce-994f-469b-b23a-1521ee9425b7 req-9b14d8b9-5f8e-4b2a-9e2d-ce73b191c741 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:16.891333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-fcba39ce-994f-469b-b23a-1521ee9425b7 req-9b14d8b9-5f8e-4b2a-9e2d-ce73b191c741 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:16.891333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-fcba39ce-994f-469b-b23a-1521ee9425b7 req-9b14d8b9-5f8e-4b2a-9e2d-ce73b191c741 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:16.892558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:16.899847 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-fcba39ce-994f-469b-b23a-1521ee9425b7 req-9b14d8b9-5f8e-4b2a-9e2d-ce73b191c741 service nova] Creating event network-vif-unplugged:d949a0c9-9094-4077-9a1f-391953b800d1 for instance a96fde59-06c5-4305-b87a-9fde71a07588 on hv-cinder-85426 Aug 24 05:56:16.904942 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-fcba39ce-994f-469b-b23a-1521ee9425b7 req-9b14d8b9-5f8e-4b2a-9e2d-ce73b191c741 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031089 Aug 24 05:56:16.905463 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 516/1026] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:56:16.934416 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2dfc39d9-e8ee-4416-8716-139bd0bfb1b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:16.935099 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2dfc39d9-e8ee-4416-8716-139bd0bfb1b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:16.941391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2dfc39d9-e8ee-4416-8716-139bd0bfb1b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:16.941922 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2dfc39d9-e8ee-4416-8716-139bd0bfb1b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:16.942388 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2dfc39d9-e8ee-4416-8716-139bd0bfb1b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:16.943076 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2dfc39d9-e8ee-4416-8716-139bd0bfb1b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:16.943532 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2dfc39d9-e8ee-4416-8716-139bd0bfb1b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:16.943956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2dfc39d9-e8ee-4416-8716-139bd0bfb1b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:17.088778 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2dfc39d9-e8ee-4416-8716-139bd0bfb1b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:17.097056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2dfc39d9-e8ee-4416-8716-139bd0bfb1b8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.167380 Aug 24 05:56:17.097628 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 517/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:16 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:17.102539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0a14cd6e-152f-4c5d-9a12-a97c2714fafc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:17.103216 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0a14cd6e-152f-4c5d-9a12-a97c2714fafc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:17.113214 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a14cd6e-152f-4c5d-9a12-a97c2714fafc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:17.113736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a14cd6e-152f-4c5d-9a12-a97c2714fafc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:17.114182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a14cd6e-152f-4c5d-9a12-a97c2714fafc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:17.114890 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a14cd6e-152f-4c5d-9a12-a97c2714fafc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:17.115369 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a14cd6e-152f-4c5d-9a12-a97c2714fafc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:17.115798 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a14cd6e-152f-4c5d-9a12-a97c2714fafc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:17.250730 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0a14cd6e-152f-4c5d-9a12-a97c2714fafc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:17.259019 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0a14cd6e-152f-4c5d-9a12-a97c2714fafc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.160420 Aug 24 05:56:17.259587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 518/1028] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:17 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:17.531404 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-24699018-bd25-4272-b4db-165e58bc35f3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "POST /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.961646 Aug 24 05:56:17.532239 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 511/1029] 10.222.0.15 () {62 vars in 1364 bytes} [Wed Aug 24 05:56:16 2022] POST /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/os-volume_attachments => generated 188 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:56:17.656895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-72eaa3b0-06f6-4b97-b60f-9393b7988df7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:17.657432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-72eaa3b0-06f6-4b97-b60f-9393b7988df7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:17.663358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72eaa3b0-06f6-4b97-b60f-9393b7988df7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:17.663834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72eaa3b0-06f6-4b97-b60f-9393b7988df7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:17.664296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72eaa3b0-06f6-4b97-b60f-9393b7988df7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:17.665018 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72eaa3b0-06f6-4b97-b60f-9393b7988df7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:17.665464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72eaa3b0-06f6-4b97-b60f-9393b7988df7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:17.665882 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-72eaa3b0-06f6-4b97-b60f-9393b7988df7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:18.119315 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-673e27cd-e78f-40b6-9dc7-9f1507d28795 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:18.119917 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-673e27cd-e78f-40b6-9dc7-9f1507d28795 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:18.126349 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-673e27cd-e78f-40b6-9dc7-9f1507d28795 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:18.126829 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-673e27cd-e78f-40b6-9dc7-9f1507d28795 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:18.127261 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-673e27cd-e78f-40b6-9dc7-9f1507d28795 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:18.127980 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-673e27cd-e78f-40b6-9dc7-9f1507d28795 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:18.128458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-673e27cd-e78f-40b6-9dc7-9f1507d28795 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:18.128887 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-673e27cd-e78f-40b6-9dc7-9f1507d28795 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:18.261638 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-673e27cd-e78f-40b6-9dc7-9f1507d28795 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:18.269977 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-673e27cd-e78f-40b6-9dc7-9f1507d28795 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.155175 Aug 24 05:56:18.270551 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 512/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:18 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:18.283042 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0cbfa675-78b2-46b0-a6e8-f6a2506a7063 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:18.283675 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0cbfa675-78b2-46b0-a6e8-f6a2506a7063 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:18.291373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0cbfa675-78b2-46b0-a6e8-f6a2506a7063 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:18.297751 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0cbfa675-78b2-46b0-a6e8-f6a2506a7063 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:18.297751 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0cbfa675-78b2-46b0-a6e8-f6a2506a7063 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:18.297751 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0cbfa675-78b2-46b0-a6e8-f6a2506a7063 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:18.297751 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0cbfa675-78b2-46b0-a6e8-f6a2506a7063 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:18.298197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0cbfa675-78b2-46b0-a6e8-f6a2506a7063 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:18.422928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-72eaa3b0-06f6-4b97-b60f-9393b7988df7 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/os-volume_attachments/76604968-14b6-4106-897c-cabdcd16c0f8" status: 202 len: 0 microversion: 2.20 time: 0.770012 Aug 24 05:56:18.424075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 519/1031] 10.222.0.15 () {60 vars in 1457 bytes} [Wed Aug 24 05:56:17 2022] DELETE /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/os-volume_attachments/76604968-14b6-4106-897c-cabdcd16c0f8 => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:56:18.436318 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0cbfa675-78b2-46b0-a6e8-f6a2506a7063 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:18.444305 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0cbfa675-78b2-46b0-a6e8-f6a2506a7063 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.166820 Aug 24 05:56:18.444907 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 513/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:18 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:18.492276 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-40dcb8d0-bac2-4d16-b3cf-32636845519e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:18.492889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-40dcb8d0-bac2-4d16-b3cf-32636845519e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:18.499031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-40dcb8d0-bac2-4d16-b3cf-32636845519e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:18.499517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-40dcb8d0-bac2-4d16-b3cf-32636845519e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:18.499943 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-40dcb8d0-bac2-4d16-b3cf-32636845519e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:18.500663 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-40dcb8d0-bac2-4d16-b3cf-32636845519e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:18.501111 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-40dcb8d0-bac2-4d16-b3cf-32636845519e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:18.501534 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-40dcb8d0-bac2-4d16-b3cf-32636845519e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:18.546184 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-40dcb8d0-bac2-4d16-b3cf-32636845519e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127756) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:56:18.785525 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-40dcb8d0-bac2-4d16-b3cf-32636845519e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "POST /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/action" status: 202 len: 0 microversion: 2.20 time: 0.296888 Aug 24 05:56:18.786079 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 520/1033] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 24 05:56:18 2022] POST /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:56:18.794625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:18.795290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:18.801524 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:18.802016 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:18.802458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:18.803158 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:18.803617 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:18.804149 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:18.939600 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:18.949071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:18.950604 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:18.951856 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-55fbabc0-921a-4531-89ca-b7ab365b80be tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1670 microversion: 2.20 time: 0.161139 Aug 24 05:56:18.952447 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 514/1034] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:18 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:19.292082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-123f9892-69d0-4f8c-9d97-5b244898a409 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:19.292795 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-123f9892-69d0-4f8c-9d97-5b244898a409 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:19.299681 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-123f9892-69d0-4f8c-9d97-5b244898a409 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:19.300164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-123f9892-69d0-4f8c-9d97-5b244898a409 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:19.300781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-123f9892-69d0-4f8c-9d97-5b244898a409 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:19.302012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-123f9892-69d0-4f8c-9d97-5b244898a409 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:19.302833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-123f9892-69d0-4f8c-9d97-5b244898a409 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:19.303606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-123f9892-69d0-4f8c-9d97-5b244898a409 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:19.449124 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-123f9892-69d0-4f8c-9d97-5b244898a409 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:19.457768 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-123f9892-69d0-4f8c-9d97-5b244898a409 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.169999 Aug 24 05:56:19.458349 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 521/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:19 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:19.473899 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-41ff55b0-e338-424c-8313-2228098d0554 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:19.474587 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-41ff55b0-e338-424c-8313-2228098d0554 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:19.481571 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41ff55b0-e338-424c-8313-2228098d0554 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:19.482137 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41ff55b0-e338-424c-8313-2228098d0554 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:19.482666 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41ff55b0-e338-424c-8313-2228098d0554 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:19.483445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41ff55b0-e338-424c-8313-2228098d0554 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:19.483980 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41ff55b0-e338-424c-8313-2228098d0554 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:19.484511 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41ff55b0-e338-424c-8313-2228098d0554 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:19.619273 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-41ff55b0-e338-424c-8313-2228098d0554 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:19.628162 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-41ff55b0-e338-424c-8313-2228098d0554 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.158049 Aug 24 05:56:19.628724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 515/1036] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:19 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:19.975667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:19.976367 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:19.983997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:19.984525 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:19.984962 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:19.985660 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:19.986120 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:19.986550 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:20.122042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:20.129418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:20.131039 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:20.132139 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-255fc070-a706-46db-ae73-587dbfa8f35c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1670 microversion: 2.20 time: 0.160487 Aug 24 05:56:20.132941 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 522/1037] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:19 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:20.479745 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-422381d8-630a-45b6-8383-bed64fdf6e0c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:20.480320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-422381d8-630a-45b6-8383-bed64fdf6e0c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:20.487367 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-422381d8-630a-45b6-8383-bed64fdf6e0c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:20.487859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-422381d8-630a-45b6-8383-bed64fdf6e0c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:20.488305 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-422381d8-630a-45b6-8383-bed64fdf6e0c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:20.489045 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-422381d8-630a-45b6-8383-bed64fdf6e0c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:20.489603 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-422381d8-630a-45b6-8383-bed64fdf6e0c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:20.490003 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-422381d8-630a-45b6-8383-bed64fdf6e0c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:20.635993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-422381d8-630a-45b6-8383-bed64fdf6e0c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:20.644533 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-422381d8-630a-45b6-8383-bed64fdf6e0c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.169331 Aug 24 05:56:20.645111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 516/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:20 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:20.649980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e2e6216c-16ab-4a39-b274-4b854ef15cfe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:20.650768 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e2e6216c-16ab-4a39-b274-4b854ef15cfe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:20.660652 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e2e6216c-16ab-4a39-b274-4b854ef15cfe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:20.661160 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e2e6216c-16ab-4a39-b274-4b854ef15cfe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:20.661775 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e2e6216c-16ab-4a39-b274-4b854ef15cfe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:20.662669 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e2e6216c-16ab-4a39-b274-4b854ef15cfe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:20.663289 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e2e6216c-16ab-4a39-b274-4b854ef15cfe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:20.663915 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e2e6216c-16ab-4a39-b274-4b854ef15cfe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:20.806149 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e2e6216c-16ab-4a39-b274-4b854ef15cfe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:20.814711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e2e6216c-16ab-4a39-b274-4b854ef15cfe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.168752 Aug 24 05:56:20.815387 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 523/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:20 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:21.155271 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:21.155873 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:21.162180 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:21.162901 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:21.163344 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:21.164715 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:21.165176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:21.165605 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:21.320067 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:21.328504 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:21.330010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:21.331171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-5857e444-ea14-48ce-a134-96958bfad66e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.179987 Aug 24 05:56:21.331732 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 517/1040] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:21 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:21.671312 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b16c1077-dd1a-4b49-a73a-be177a4714cb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:21.671924 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b16c1077-dd1a-4b49-a73a-be177a4714cb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:21.679398 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b16c1077-dd1a-4b49-a73a-be177a4714cb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:21.679868 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b16c1077-dd1a-4b49-a73a-be177a4714cb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:21.680304 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b16c1077-dd1a-4b49-a73a-be177a4714cb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:21.681061 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b16c1077-dd1a-4b49-a73a-be177a4714cb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:21.681523 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b16c1077-dd1a-4b49-a73a-be177a4714cb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:21.681944 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b16c1077-dd1a-4b49-a73a-be177a4714cb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:21.838734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0f91e94e-d293-41de-9e08-a3599a00dd97 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:21.840131 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0f91e94e-d293-41de-9e08-a3599a00dd97 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:21.840418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b16c1077-dd1a-4b49-a73a-be177a4714cb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:21.847914 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0f91e94e-d293-41de-9e08-a3599a00dd97 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:21.848756 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0f91e94e-d293-41de-9e08-a3599a00dd97 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:21.849438 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0f91e94e-d293-41de-9e08-a3599a00dd97 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:21.850099 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b16c1077-dd1a-4b49-a73a-be177a4714cb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.182775 Aug 24 05:56:21.850597 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0f91e94e-d293-41de-9e08-a3599a00dd97 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:21.854789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 524/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:21 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:21.855734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0f91e94e-d293-41de-9e08-a3599a00dd97 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:21.856813 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0f91e94e-d293-41de-9e08-a3599a00dd97 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:22.003683 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0f91e94e-d293-41de-9e08-a3599a00dd97 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:22.011973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0f91e94e-d293-41de-9e08-a3599a00dd97 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.178168 Aug 24 05:56:22.012766 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 518/1042] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:21 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:22.355585 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:22.356190 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:22.362170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:22.362655 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:22.363092 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:22.363772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:22.364233 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:22.364680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:22.506330 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:22.516383 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:22.518004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:22.519252 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-237e0938-99e0-47ce-af2d-f77e60283994 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.168347 Aug 24 05:56:22.519910 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 525/1043] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:22 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:22.873330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f1ca07e4-6733-40a1-83cd-96aa1b25ccc5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:22.874091 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f1ca07e4-6733-40a1-83cd-96aa1b25ccc5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:22.880726 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1ca07e4-6733-40a1-83cd-96aa1b25ccc5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:22.887033 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1ca07e4-6733-40a1-83cd-96aa1b25ccc5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:22.887586 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1ca07e4-6733-40a1-83cd-96aa1b25ccc5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:22.888446 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1ca07e4-6733-40a1-83cd-96aa1b25ccc5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:22.888946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1ca07e4-6733-40a1-83cd-96aa1b25ccc5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:22.889387 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f1ca07e4-6733-40a1-83cd-96aa1b25ccc5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:23.037244 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f08171a3-d87d-42c4-8acf-4a3a01964853 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:23.038478 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f08171a3-d87d-42c4-8acf-4a3a01964853 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:23.051026 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f08171a3-d87d-42c4-8acf-4a3a01964853 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:23.053062 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f08171a3-d87d-42c4-8acf-4a3a01964853 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:23.053708 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f08171a3-d87d-42c4-8acf-4a3a01964853 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:23.055093 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f08171a3-d87d-42c4-8acf-4a3a01964853 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:23.055761 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f08171a3-d87d-42c4-8acf-4a3a01964853 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:23.056355 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f08171a3-d87d-42c4-8acf-4a3a01964853 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:23.070864 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f1ca07e4-6733-40a1-83cd-96aa1b25ccc5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:23.079858 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f1ca07e4-6733-40a1-83cd-96aa1b25ccc5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.210658 Aug 24 05:56:23.080656 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 519/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:22 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:23.171856 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-5d6cc4e4-48c8-4112-8879-e842947a4271 req-5286a741-e299-4b43-a7c7-3ad38cb5de41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930020e6-49a9-488f-870a-1da855b88720", "name": "network-vif-plugged", "status": "completed", "tag": "05efbf18-2e2f-490b-b7d8-fda19d6de7d8"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:23.191886 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5d6cc4e4-48c8-4112-8879-e842947a4271 req-5286a741-e299-4b43-a7c7-3ad38cb5de41 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:23.192382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5d6cc4e4-48c8-4112-8879-e842947a4271 req-5286a741-e299-4b43-a7c7-3ad38cb5de41 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:23.192846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-5d6cc4e4-48c8-4112-8879-e842947a4271 req-5286a741-e299-4b43-a7c7-3ad38cb5de41 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:23.212147 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-5d6cc4e4-48c8-4112-8879-e842947a4271 req-5286a741-e299-4b43-a7c7-3ad38cb5de41 service nova] Creating event network-vif-plugged:05efbf18-2e2f-490b-b7d8-fda19d6de7d8 for instance 930020e6-49a9-488f-870a-1da855b88720 on hv-cinder-85426 Aug 24 05:56:23.218441 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-5d6cc4e4-48c8-4112-8879-e842947a4271 req-5286a741-e299-4b43-a7c7-3ad38cb5de41 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051143 Aug 24 05:56:23.223472 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 520/1045] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:56:23.239568 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f08171a3-d87d-42c4-8acf-4a3a01964853 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:23.247770 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f08171a3-d87d-42c4-8acf-4a3a01964853 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.218195 Aug 24 05:56:23.248510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 526/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:23 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:23.544390 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:23.545171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:23.552065 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:23.552591 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:23.553246 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:23.553959 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:23.554962 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:23.555400 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:23.697986 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:23.706406 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:23.707958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:23.709161 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0ae36013-eff8-40d5-9bf5-fa3bae6c9ab2 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.170160 Aug 24 05:56:23.709725 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 521/1047] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:23 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:24.102980 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d3375ebc-3e4d-484e-aa91-ecc2968e51ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:24.103593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d3375ebc-3e4d-484e-aa91-ecc2968e51ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:24.110181 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3375ebc-3e4d-484e-aa91-ecc2968e51ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:24.110670 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3375ebc-3e4d-484e-aa91-ecc2968e51ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:24.111108 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3375ebc-3e4d-484e-aa91-ecc2968e51ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:24.111807 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3375ebc-3e4d-484e-aa91-ecc2968e51ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:24.112266 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3375ebc-3e4d-484e-aa91-ecc2968e51ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:24.112733 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d3375ebc-3e4d-484e-aa91-ecc2968e51ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:24.256351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d3375ebc-3e4d-484e-aa91-ecc2968e51ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:24.265614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d3375ebc-3e4d-484e-aa91-ecc2968e51ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.167522 Aug 24 05:56:24.266166 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 527/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:24 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:24.270104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8f70549a-8a05-4940-946a-fa26aa31ec49 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:24.270716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8f70549a-8a05-4940-946a-fa26aa31ec49 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:24.277582 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f70549a-8a05-4940-946a-fa26aa31ec49 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:24.278062 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f70549a-8a05-4940-946a-fa26aa31ec49 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:24.278506 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f70549a-8a05-4940-946a-fa26aa31ec49 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:24.279195 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f70549a-8a05-4940-946a-fa26aa31ec49 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:24.279654 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f70549a-8a05-4940-946a-fa26aa31ec49 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:24.280085 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8f70549a-8a05-4940-946a-fa26aa31ec49 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:24.422756 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8f70549a-8a05-4940-946a-fa26aa31ec49 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:24.431846 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8f70549a-8a05-4940-946a-fa26aa31ec49 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.165975 Aug 24 05:56:24.432439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 522/1049] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:24 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:24.732807 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:24.733430 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:24.740583 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:24.741084 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:24.741528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:24.743507 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:24.743988 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:24.744455 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:24.887664 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:24.896385 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:24.897917 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:24.899089 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bd67fd2d-a7dd-4d8c-9aed-2e639d3b4f49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.170654 Aug 24 05:56:24.909356 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 528/1050] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:24 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:25.287206 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1f2d36cc-6867-416a-bfa3-158a4d30ad4f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:25.287829 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1f2d36cc-6867-416a-bfa3-158a4d30ad4f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:25.295085 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f2d36cc-6867-416a-bfa3-158a4d30ad4f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:25.295576 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f2d36cc-6867-416a-bfa3-158a4d30ad4f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:25.296036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f2d36cc-6867-416a-bfa3-158a4d30ad4f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:25.296762 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f2d36cc-6867-416a-bfa3-158a4d30ad4f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:25.297220 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f2d36cc-6867-416a-bfa3-158a4d30ad4f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:25.297649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f2d36cc-6867-416a-bfa3-158a4d30ad4f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:25.452007 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1f2d36cc-6867-416a-bfa3-158a4d30ad4f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:25.454036 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-16ed7925-0178-4869-bd86-14450814ec5e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:25.455201 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-16ed7925-0178-4869-bd86-14450814ec5e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:25.461202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1f2d36cc-6867-416a-bfa3-158a4d30ad4f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.177276 Aug 24 05:56:25.462176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 523/1051] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:25 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:25.462940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16ed7925-0178-4869-bd86-14450814ec5e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:25.463438 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16ed7925-0178-4869-bd86-14450814ec5e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:25.463879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16ed7925-0178-4869-bd86-14450814ec5e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:25.464615 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16ed7925-0178-4869-bd86-14450814ec5e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:25.465075 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16ed7925-0178-4869-bd86-14450814ec5e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:25.465504 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-16ed7925-0178-4869-bd86-14450814ec5e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:25.608153 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-16ed7925-0178-4869-bd86-14450814ec5e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:25.611762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:25.616331 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-16ed7925-0178-4869-bd86-14450814ec5e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.166227 Aug 24 05:56:25.616939 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 529/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:25 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:26.059012 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:26.059631 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:26.066225 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:26.066717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:26.067157 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:26.068351 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:26.068351 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:26.068813 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:26.208248 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:26.212736 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:26.217909 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:26.219613 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:26.220814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2177f18f-2d97-482f-810b-83b811f253e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.302522 Aug 24 05:56:26.221686 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 524/1053] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:25 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:26.483016 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-64c17a35-db60-48a2-8b01-aa0c81d6e700 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:26.483572 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-64c17a35-db60-48a2-8b01-aa0c81d6e700 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:26.490661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64c17a35-db60-48a2-8b01-aa0c81d6e700 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:26.491147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64c17a35-db60-48a2-8b01-aa0c81d6e700 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:26.491659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64c17a35-db60-48a2-8b01-aa0c81d6e700 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:26.492914 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64c17a35-db60-48a2-8b01-aa0c81d6e700 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:26.493379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64c17a35-db60-48a2-8b01-aa0c81d6e700 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:26.493813 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64c17a35-db60-48a2-8b01-aa0c81d6e700 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:26.638498 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-bb65f7ef-e604-413f-b0cc-feca83de060d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:26.639028 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-64c17a35-db60-48a2-8b01-aa0c81d6e700 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:26.639138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-bb65f7ef-e604-413f-b0cc-feca83de060d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:26.646211 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bb65f7ef-e604-413f-b0cc-feca83de060d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:26.646709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bb65f7ef-e604-413f-b0cc-feca83de060d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:26.653595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bb65f7ef-e604-413f-b0cc-feca83de060d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:26.653595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bb65f7ef-e604-413f-b0cc-feca83de060d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:26.653595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bb65f7ef-e604-413f-b0cc-feca83de060d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:26.653595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bb65f7ef-e604-413f-b0cc-feca83de060d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:26.655562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-64c17a35-db60-48a2-8b01-aa0c81d6e700 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.174866 Aug 24 05:56:26.656435 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 530/1054] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:26 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:26.798641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-bb65f7ef-e604-413f-b0cc-feca83de060d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:26.808440 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-bb65f7ef-e604-413f-b0cc-feca83de060d tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.175648 Aug 24 05:56:26.809528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 525/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:26 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:27.244760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:27.246003 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:27.253271 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:27.253897 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:27.254546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:27.255358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:27.255917 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:27.256500 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:27.403134 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:27.419381 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:27.419381 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:27.419381 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3d35259c-5f07-43a6-8725-6ef5507f5b45 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.176145 Aug 24 05:56:27.419821 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 531/1056] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:27 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:27.677704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-78dbd685-e25a-4a11-a072-4cad9ff317bd tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:27.678322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-78dbd685-e25a-4a11-a072-4cad9ff317bd tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:27.685844 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78dbd685-e25a-4a11-a072-4cad9ff317bd tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:27.686418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78dbd685-e25a-4a11-a072-4cad9ff317bd tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:27.686870 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78dbd685-e25a-4a11-a072-4cad9ff317bd tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:27.687637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78dbd685-e25a-4a11-a072-4cad9ff317bd tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:27.688163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78dbd685-e25a-4a11-a072-4cad9ff317bd tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:27.688637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78dbd685-e25a-4a11-a072-4cad9ff317bd tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:27.828999 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-78dbd685-e25a-4a11-a072-4cad9ff317bd tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:27.830602 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4292fd3a-ed5a-4d7e-bede-e7d32595c32b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:27.831222 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4292fd3a-ed5a-4d7e-bede-e7d32595c32b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:27.838417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-78dbd685-e25a-4a11-a072-4cad9ff317bd tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.164796 Aug 24 05:56:27.838652 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4292fd3a-ed5a-4d7e-bede-e7d32595c32b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:27.838997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4292fd3a-ed5a-4d7e-bede-e7d32595c32b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:27.839424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4292fd3a-ed5a-4d7e-bede-e7d32595c32b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:27.840546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4292fd3a-ed5a-4d7e-bede-e7d32595c32b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:27.841063 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4292fd3a-ed5a-4d7e-bede-e7d32595c32b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:27.841492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4292fd3a-ed5a-4d7e-bede-e7d32595c32b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:27.854000 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 526/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:27 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:28.000790 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4292fd3a-ed5a-4d7e-bede-e7d32595c32b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:28.009670 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4292fd3a-ed5a-4d7e-bede-e7d32595c32b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.183148 Aug 24 05:56:28.010539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 532/1058] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:27 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:28.441210 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:28.441848 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:28.449001 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:28.449490 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:28.449952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:28.450668 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:28.451134 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:28.451569 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:28.594163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:28.605713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:28.607702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:28.609144 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-628f45f1-44d7-4b2c-be89-019a1fd23592 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.171890 Aug 24 05:56:28.610143 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 527/1059] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:28 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:28.861116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a292f5ef-a709-4a38-9804-d076d76d833c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:28.861677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a292f5ef-a709-4a38-9804-d076d76d833c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:28.868905 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a292f5ef-a709-4a38-9804-d076d76d833c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:28.869402 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a292f5ef-a709-4a38-9804-d076d76d833c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:28.869846 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a292f5ef-a709-4a38-9804-d076d76d833c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:28.870558 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a292f5ef-a709-4a38-9804-d076d76d833c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:28.871020 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a292f5ef-a709-4a38-9804-d076d76d833c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:28.871449 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a292f5ef-a709-4a38-9804-d076d76d833c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:29.007394 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a292f5ef-a709-4a38-9804-d076d76d833c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:29.017516 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a292f5ef-a709-4a38-9804-d076d76d833c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.160179 Aug 24 05:56:29.025367 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 533/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:28 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:29.031528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-5e929846-1880-4bca-b5e5-9a290994570c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:29.032141 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5e929846-1880-4bca-b5e5-9a290994570c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:29.038930 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5e929846-1880-4bca-b5e5-9a290994570c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:29.039417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5e929846-1880-4bca-b5e5-9a290994570c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:29.039856 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5e929846-1880-4bca-b5e5-9a290994570c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:29.040595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5e929846-1880-4bca-b5e5-9a290994570c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:29.041077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5e929846-1880-4bca-b5e5-9a290994570c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:29.041562 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5e929846-1880-4bca-b5e5-9a290994570c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:29.189721 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5e929846-1880-4bca-b5e5-9a290994570c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:29.198589 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-5e929846-1880-4bca-b5e5-9a290994570c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.171005 Aug 24 05:56:29.199167 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 528/1061] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:29 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:29.632172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:29.633618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:29.639955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:29.640473 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:29.640908 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:29.641601 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:29.642052 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:29.642472 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:29.786103 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:29.795081 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:29.796719 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:29.797705 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-dcd68af2-c3c2-40c0-80ff-4fee1056b91d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.169444 Aug 24 05:56:29.798489 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 534/1062] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:29 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:30.038715 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-46e38217-ab94-4156-9486-3239085c2aed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:30.039567 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-46e38217-ab94-4156-9486-3239085c2aed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:30.041978 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=72 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:30.048034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-46e38217-ab94-4156-9486-3239085c2aed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:30.048633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-46e38217-ab94-4156-9486-3239085c2aed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:30.049357 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-46e38217-ab94-4156-9486-3239085c2aed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:30.050077 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-46e38217-ab94-4156-9486-3239085c2aed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:30.050544 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-46e38217-ab94-4156-9486-3239085c2aed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:30.050976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-46e38217-ab94-4156-9486-3239085c2aed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:30.209982 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-46e38217-ab94-4156-9486-3239085c2aed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:30.211896 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-46e38217-ab94-4156-9486-3239085c2aed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.177103 Aug 24 05:56:30.217241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 529/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:30 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:30.219223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ae1f55e6-8e8f-4726-ab8b-bf670022798b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:30.219950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ae1f55e6-8e8f-4726-ab8b-bf670022798b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:30.227676 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae1f55e6-8e8f-4726-ab8b-bf670022798b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:30.228458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae1f55e6-8e8f-4726-ab8b-bf670022798b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:30.228906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae1f55e6-8e8f-4726-ab8b-bf670022798b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:30.229617 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae1f55e6-8e8f-4726-ab8b-bf670022798b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:30.230079 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae1f55e6-8e8f-4726-ab8b-bf670022798b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:30.230668 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ae1f55e6-8e8f-4726-ab8b-bf670022798b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:30.372072 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ae1f55e6-8e8f-4726-ab8b-bf670022798b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:30.379897 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ae1f55e6-8e8f-4726-ab8b-bf670022798b tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.164586 Aug 24 05:56:30.380493 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 535/1064] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:30 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:30.822778 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:30.823538 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:30.829849 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:30.830342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:30.830781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:30.831483 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:30.831943 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:30.832373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:30.975508 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:30.985825 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:30.987354 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:30.988625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3dd75f38-6ebf-42b0-99e3-e4cfa3a6f747 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.171204 Aug 24 05:56:30.989439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 530/1065] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:30 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:31.233719 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e861f2a0-4df1-4165-9f06-4f539e8c96de tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:31.234418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e861f2a0-4df1-4165-9f06-4f539e8c96de tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:31.238234 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:31.244525 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e861f2a0-4df1-4165-9f06-4f539e8c96de tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:31.245032 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e861f2a0-4df1-4165-9f06-4f539e8c96de tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:31.245478 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e861f2a0-4df1-4165-9f06-4f539e8c96de tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:31.246191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e861f2a0-4df1-4165-9f06-4f539e8c96de tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:31.246654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e861f2a0-4df1-4165-9f06-4f539e8c96de tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:31.247083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e861f2a0-4df1-4165-9f06-4f539e8c96de tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:31.389444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e861f2a0-4df1-4165-9f06-4f539e8c96de tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:31.401249 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2f709320-2fc1-4bca-b57e-4bc70f9127ac tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:31.402198 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2f709320-2fc1-4bca-b57e-4bc70f9127ac tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:31.409092 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f709320-2fc1-4bca-b57e-4bc70f9127ac tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:31.409758 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f709320-2fc1-4bca-b57e-4bc70f9127ac tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:31.409905 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e861f2a0-4df1-4165-9f06-4f539e8c96de tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.180050 Aug 24 05:56:31.410197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f709320-2fc1-4bca-b57e-4bc70f9127ac tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:31.410419 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 536/1066] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:31 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:31.410898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f709320-2fc1-4bca-b57e-4bc70f9127ac tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:31.411355 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f709320-2fc1-4bca-b57e-4bc70f9127ac tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:31.411811 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2f709320-2fc1-4bca-b57e-4bc70f9127ac tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:31.562740 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2f709320-2fc1-4bca-b57e-4bc70f9127ac tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:31.571281 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2f709320-2fc1-4bca-b57e-4bc70f9127ac tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.173968 Aug 24 05:56:31.571855 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 531/1067] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:31 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:32.014187 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:32.015023 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:32.021605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:32.022103 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:32.022708 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:32.023475 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:32.024009 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:32.024494 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:32.181866 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:32.189164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:32.190976 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:32.193114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e5282f27-7285-409c-9021-949bbe6b5e06 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.183160 Aug 24 05:56:32.197095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 537/1068] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:32 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:32.435122 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a1f551e4-f3a9-4fd5-8619-bd6a15ad95b0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:32.435767 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a1f551e4-f3a9-4fd5-8619-bd6a15ad95b0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:32.442490 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a1f551e4-f3a9-4fd5-8619-bd6a15ad95b0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:32.443278 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a1f551e4-f3a9-4fd5-8619-bd6a15ad95b0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:32.443930 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a1f551e4-f3a9-4fd5-8619-bd6a15ad95b0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:32.444989 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a1f551e4-f3a9-4fd5-8619-bd6a15ad95b0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:32.445657 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a1f551e4-f3a9-4fd5-8619-bd6a15ad95b0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:32.446306 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a1f551e4-f3a9-4fd5-8619-bd6a15ad95b0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:32.590035 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a1f551e4-f3a9-4fd5-8619-bd6a15ad95b0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:32.592818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a436c049-68f1-42a1-aea6-9f2eb64b04cf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:32.594050 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a436c049-68f1-42a1-aea6-9f2eb64b04cf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:32.603441 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a436c049-68f1-42a1-aea6-9f2eb64b04cf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:32.604268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a436c049-68f1-42a1-aea6-9f2eb64b04cf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:32.605276 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a436c049-68f1-42a1-aea6-9f2eb64b04cf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:32.606191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a436c049-68f1-42a1-aea6-9f2eb64b04cf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:32.606816 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a436c049-68f1-42a1-aea6-9f2eb64b04cf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:32.607409 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a436c049-68f1-42a1-aea6-9f2eb64b04cf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:32.608003 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a1f551e4-f3a9-4fd5-8619-bd6a15ad95b0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.176968 Aug 24 05:56:32.608812 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 532/1069] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:32 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:32.625964 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f23ea9f7-d120-46a1-a6ee-4c3dc6071cc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:32.626809 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f23ea9f7-d120-46a1-a6ee-4c3dc6071cc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:32.639542 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f23ea9f7-d120-46a1-a6ee-4c3dc6071cc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:32.639918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f23ea9f7-d120-46a1-a6ee-4c3dc6071cc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:32.641036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f23ea9f7-d120-46a1-a6ee-4c3dc6071cc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:32.642293 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f23ea9f7-d120-46a1-a6ee-4c3dc6071cc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:32.642894 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f23ea9f7-d120-46a1-a6ee-4c3dc6071cc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:32.643409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f23ea9f7-d120-46a1-a6ee-4c3dc6071cc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:32.673835 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f23ea9f7-d120-46a1-a6ee-4c3dc6071cc7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/ips" status: 200 len: 150 microversion: 2.1 time: 0.054653 Aug 24 05:56:32.674799 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 533/1070] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 24 05:56:32 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:56:32.829637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a436c049-68f1-42a1-aea6-9f2eb64b04cf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:32.845738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a436c049-68f1-42a1-aea6-9f2eb64b04cf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.254563 Aug 24 05:56:32.863681 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 538/1071] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:32 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:33.216069 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:33.216706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:33.223549 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:33.224268 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:33.224749 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:33.225711 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:33.226192 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:33.226801 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:33.372926 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:33.378808 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:33.380372 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:33.381594 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d91f958b-3121-49c1-9407-f3fc7c38929d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.169616 Aug 24 05:56:33.382207 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 534/1072] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:33 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:33.633864 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-831578bf-c837-4d8f-8f7a-83a186114a86 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:33.634508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-831578bf-c837-4d8f-8f7a-83a186114a86 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:33.641079 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-831578bf-c837-4d8f-8f7a-83a186114a86 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:33.641563 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-831578bf-c837-4d8f-8f7a-83a186114a86 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:33.642054 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-831578bf-c837-4d8f-8f7a-83a186114a86 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:33.642774 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-831578bf-c837-4d8f-8f7a-83a186114a86 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:33.643233 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-831578bf-c837-4d8f-8f7a-83a186114a86 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:33.643666 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-831578bf-c837-4d8f-8f7a-83a186114a86 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:33.782124 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-831578bf-c837-4d8f-8f7a-83a186114a86 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:33.790988 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-831578bf-c837-4d8f-8f7a-83a186114a86 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.161888 Aug 24 05:56:33.791548 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 539/1073] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:33 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:33.869702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ecc718b4-1535-4f4c-aa1f-8dac376b6b0e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:33.870268 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ecc718b4-1535-4f4c-aa1f-8dac376b6b0e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:33.877116 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ecc718b4-1535-4f4c-aa1f-8dac376b6b0e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:33.877607 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ecc718b4-1535-4f4c-aa1f-8dac376b6b0e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:33.878104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ecc718b4-1535-4f4c-aa1f-8dac376b6b0e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:33.878810 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ecc718b4-1535-4f4c-aa1f-8dac376b6b0e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:33.879274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ecc718b4-1535-4f4c-aa1f-8dac376b6b0e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:33.879708 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ecc718b4-1535-4f4c-aa1f-8dac376b6b0e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:34.013859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ecc718b4-1535-4f4c-aa1f-8dac376b6b0e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:34.021569 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ecc718b4-1535-4f4c-aa1f-8dac376b6b0e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.156743 Aug 24 05:56:34.022129 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 535/1074] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:33 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:34.405364 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:34.405979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:34.412112 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:34.412635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:34.413076 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:34.414461 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:34.414922 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:34.415392 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:34.564677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:34.573566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:34.575074 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:34.576223 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-809b12e9-3371-4630-b414-7af2fbea553d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.174866 Aug 24 05:56:34.576815 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 540/1075] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:34 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:34.812954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7e87bb03-d4bb-4b0b-bddd-4c236346d65d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:34.813477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7e87bb03-d4bb-4b0b-bddd-4c236346d65d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:34.819384 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e87bb03-d4bb-4b0b-bddd-4c236346d65d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:34.820633 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e87bb03-d4bb-4b0b-bddd-4c236346d65d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:34.821125 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e87bb03-d4bb-4b0b-bddd-4c236346d65d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:34.822136 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e87bb03-d4bb-4b0b-bddd-4c236346d65d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:34.822246 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e87bb03-d4bb-4b0b-bddd-4c236346d65d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:34.822678 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7e87bb03-d4bb-4b0b-bddd-4c236346d65d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:34.963675 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7e87bb03-d4bb-4b0b-bddd-4c236346d65d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:34.971976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7e87bb03-d4bb-4b0b-bddd-4c236346d65d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.163039 Aug 24 05:56:34.972574 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 536/1076] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:34 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:35.042377 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e82303e6-6d7c-4184-8d89-0c4ed153aff8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:35.042973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e82303e6-6d7c-4184-8d89-0c4ed153aff8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:35.049691 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e82303e6-6d7c-4184-8d89-0c4ed153aff8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:35.050164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e82303e6-6d7c-4184-8d89-0c4ed153aff8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:35.050592 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e82303e6-6d7c-4184-8d89-0c4ed153aff8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:35.051277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e82303e6-6d7c-4184-8d89-0c4ed153aff8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:35.051731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e82303e6-6d7c-4184-8d89-0c4ed153aff8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:35.052149 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e82303e6-6d7c-4184-8d89-0c4ed153aff8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:35.192747 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e82303e6-6d7c-4184-8d89-0c4ed153aff8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:35.201710 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e82303e6-6d7c-4184-8d89-0c4ed153aff8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.163144 Aug 24 05:56:35.204850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 541/1077] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:35 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:35.542902 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3564b915-ea1b-4192-b042-2dc7a0c95815 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "148835c2-ccd6-4323-aed7-c5616d93ce5d"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:35.545351 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3564b915-ea1b-4192-b042-2dc7a0c95815 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:35.551606 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3564b915-ea1b-4192-b042-2dc7a0c95815 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:35.552082 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3564b915-ea1b-4192-b042-2dc7a0c95815 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:35.552545 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3564b915-ea1b-4192-b042-2dc7a0c95815 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:35.553231 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3564b915-ea1b-4192-b042-2dc7a0c95815 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:35.553683 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3564b915-ea1b-4192-b042-2dc7a0c95815 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:35.554861 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3564b915-ea1b-4192-b042-2dc7a0c95815 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:35.599427 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:35.601849 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:35.607437 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:35.607920 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:35.608360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:35.609083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:35.609588 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:35.610061 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:35.748547 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:35.756922 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:35.758435 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:35.759717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-aeb31087-6698-4045-a9ab-c07382928a37 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.164252 Aug 24 05:56:35.760271 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 542/1078] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:35 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:35.993417 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-049b540e-ef23-4425-98a8-1099f6a050b9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:35.994040 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-049b540e-ef23-4425-98a8-1099f6a050b9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:36.000154 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049b540e-ef23-4425-98a8-1099f6a050b9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:36.000626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049b540e-ef23-4425-98a8-1099f6a050b9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:36.001073 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049b540e-ef23-4425-98a8-1099f6a050b9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:36.001761 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049b540e-ef23-4425-98a8-1099f6a050b9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:36.002221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049b540e-ef23-4425-98a8-1099f6a050b9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:36.002694 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-049b540e-ef23-4425-98a8-1099f6a050b9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:36.137270 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-049b540e-ef23-4425-98a8-1099f6a050b9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:36.145641 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-049b540e-ef23-4425-98a8-1099f6a050b9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.156402 Aug 24 05:56:36.146204 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 543/1079] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:35 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:36.222394 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f6c8ddbc-ee7a-4fe6-89ed-a8d6985c4bf8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:36.223145 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f6c8ddbc-ee7a-4fe6-89ed-a8d6985c4bf8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:36.229406 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f6c8ddbc-ee7a-4fe6-89ed-a8d6985c4bf8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:36.229892 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f6c8ddbc-ee7a-4fe6-89ed-a8d6985c4bf8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:36.230328 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f6c8ddbc-ee7a-4fe6-89ed-a8d6985c4bf8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:36.231019 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f6c8ddbc-ee7a-4fe6-89ed-a8d6985c4bf8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:36.231475 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f6c8ddbc-ee7a-4fe6-89ed-a8d6985c4bf8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:36.231901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f6c8ddbc-ee7a-4fe6-89ed-a8d6985c4bf8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:36.364845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f6c8ddbc-ee7a-4fe6-89ed-a8d6985c4bf8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:36.373057 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f6c8ddbc-ee7a-4fe6-89ed-a8d6985c4bf8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.154676 Aug 24 05:56:36.373648 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 544/1080] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:36 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:36.782167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:36.782770 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:36.789965 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:36.790451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:36.790893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:36.791586 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:36.792051 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:36.792506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:36.924893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:36.934399 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:36.935918 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:36.937128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-60b4294a-bc1e-4f99-9c3a-1ffeca066d5e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.158984 Aug 24 05:56:36.937686 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 545/1081] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:36 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:37.168272 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5677fce1-354e-4dce-9cb1-fd3bbb1eeb14 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:37.168988 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5677fce1-354e-4dce-9cb1-fd3bbb1eeb14 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:37.175121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5677fce1-354e-4dce-9cb1-fd3bbb1eeb14 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:37.175618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5677fce1-354e-4dce-9cb1-fd3bbb1eeb14 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:37.176051 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5677fce1-354e-4dce-9cb1-fd3bbb1eeb14 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:37.176762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5677fce1-354e-4dce-9cb1-fd3bbb1eeb14 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:37.177213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5677fce1-354e-4dce-9cb1-fd3bbb1eeb14 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:37.177627 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5677fce1-354e-4dce-9cb1-fd3bbb1eeb14 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:37.200832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:37.325931 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5677fce1-354e-4dce-9cb1-fd3bbb1eeb14 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:37.335714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5677fce1-354e-4dce-9cb1-fd3bbb1eeb14 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.171830 Aug 24 05:56:37.336301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 546/1082] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:37 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:37.394856 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-45a4b97a-037e-471d-8c23-3ef1ee5a47b7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:37.618508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-45a4b97a-037e-471d-8c23-3ef1ee5a47b7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:37.618508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45a4b97a-037e-471d-8c23-3ef1ee5a47b7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:37.618508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45a4b97a-037e-471d-8c23-3ef1ee5a47b7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:37.618508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45a4b97a-037e-471d-8c23-3ef1ee5a47b7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:37.619283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45a4b97a-037e-471d-8c23-3ef1ee5a47b7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:37.619283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45a4b97a-037e-471d-8c23-3ef1ee5a47b7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:37.619283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-45a4b97a-037e-471d-8c23-3ef1ee5a47b7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:37.619554 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-45a4b97a-037e-471d-8c23-3ef1ee5a47b7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:37.619554 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-45a4b97a-037e-471d-8c23-3ef1ee5a47b7 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.163897 Aug 24 05:56:37.619554 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 547/1083] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:37 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:37.960745 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:37.961361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:37.967403 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:37.967886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:37.968324 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:37.969044 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:37.969536 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:37.969969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:38.099091 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:38.107724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:38.109281 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:38.110568 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-57cf2e1d-8f66-410a-9eb3-6c1b409855aa tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.154060 Aug 24 05:56:38.111133 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 548/1084] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:37 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:38.358363 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d64dd930-4413-41b7-a920-0c0507408577 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:38.359083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d64dd930-4413-41b7-a920-0c0507408577 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:38.365385 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d64dd930-4413-41b7-a920-0c0507408577 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:38.365871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d64dd930-4413-41b7-a920-0c0507408577 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:38.366402 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d64dd930-4413-41b7-a920-0c0507408577 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:38.367618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d64dd930-4413-41b7-a920-0c0507408577 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:38.368077 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d64dd930-4413-41b7-a920-0c0507408577 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:38.368544 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d64dd930-4413-41b7-a920-0c0507408577 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:38.498646 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d64dd930-4413-41b7-a920-0c0507408577 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:38.506819 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d64dd930-4413-41b7-a920-0c0507408577 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.152348 Aug 24 05:56:38.507941 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 549/1085] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:38 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:38.637976 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1a7c66a2-858f-4e56-8f3c-53f79ac96a51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:38.638686 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1a7c66a2-858f-4e56-8f3c-53f79ac96a51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:38.644688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a7c66a2-858f-4e56-8f3c-53f79ac96a51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:38.645163 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a7c66a2-858f-4e56-8f3c-53f79ac96a51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:38.645592 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a7c66a2-858f-4e56-8f3c-53f79ac96a51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:38.646271 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a7c66a2-858f-4e56-8f3c-53f79ac96a51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:38.646718 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a7c66a2-858f-4e56-8f3c-53f79ac96a51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:38.647136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a7c66a2-858f-4e56-8f3c-53f79ac96a51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:38.783785 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1a7c66a2-858f-4e56-8f3c-53f79ac96a51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:38.792162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1a7c66a2-858f-4e56-8f3c-53f79ac96a51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.158082 Aug 24 05:56:38.792754 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 550/1086] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:38 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:39.135261 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:39.135882 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:39.142053 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:39.142545 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:39.142974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:39.143781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:39.144242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:39.144704 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:39.275214 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:39.283389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:39.284934 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:39.286082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0a8f1ab9-a3de-479e-bfb2-8dcdee34e018 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.155630 Aug 24 05:56:39.286639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 551/1087] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:39 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:39.528862 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d2f1c4b8-a0da-46f7-8c09-aa766b1fd72e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:39.529475 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d2f1c4b8-a0da-46f7-8c09-aa766b1fd72e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:39.535744 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2f1c4b8-a0da-46f7-8c09-aa766b1fd72e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:39.536220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2f1c4b8-a0da-46f7-8c09-aa766b1fd72e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:39.536696 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2f1c4b8-a0da-46f7-8c09-aa766b1fd72e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:39.537384 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2f1c4b8-a0da-46f7-8c09-aa766b1fd72e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:39.537865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2f1c4b8-a0da-46f7-8c09-aa766b1fd72e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:39.538316 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d2f1c4b8-a0da-46f7-8c09-aa766b1fd72e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:39.671107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d2f1c4b8-a0da-46f7-8c09-aa766b1fd72e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:39.680330 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d2f1c4b8-a0da-46f7-8c09-aa766b1fd72e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.155345 Aug 24 05:56:39.680923 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 552/1088] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:39 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:39.813296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1a031c10-45ce-45c0-b0a2-10000d5b4c44 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:39.813817 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1a031c10-45ce-45c0-b0a2-10000d5b4c44 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:39.819747 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a031c10-45ce-45c0-b0a2-10000d5b4c44 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:39.820229 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a031c10-45ce-45c0-b0a2-10000d5b4c44 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:39.820727 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a031c10-45ce-45c0-b0a2-10000d5b4c44 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:39.821426 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a031c10-45ce-45c0-b0a2-10000d5b4c44 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:39.821875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a031c10-45ce-45c0-b0a2-10000d5b4c44 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:39.822293 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a031c10-45ce-45c0-b0a2-10000d5b4c44 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:39.962012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1a031c10-45ce-45c0-b0a2-10000d5b4c44 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:39.969677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1a031c10-45ce-45c0-b0a2-10000d5b4c44 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.160338 Aug 24 05:56:39.970253 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 553/1089] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:39 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:40.309390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:40.310030 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:40.316094 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:40.316612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:40.317058 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:40.317746 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:40.318206 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:40.318635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:40.451904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:40.461522 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:40.463048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:40.464209 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6b492ba6-b6d0-4c4e-a083-6fe73fed43de tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.158991 Aug 24 05:56:40.464811 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 554/1090] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:40 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:40.704197 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6fb2bdec-8749-49c8-9376-2b44223bd5b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:40.704889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6fb2bdec-8749-49c8-9376-2b44223bd5b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:40.712606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fb2bdec-8749-49c8-9376-2b44223bd5b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:40.713102 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fb2bdec-8749-49c8-9376-2b44223bd5b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:40.713551 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fb2bdec-8749-49c8-9376-2b44223bd5b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:40.714261 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fb2bdec-8749-49c8-9376-2b44223bd5b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:40.714720 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fb2bdec-8749-49c8-9376-2b44223bd5b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:40.715148 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6fb2bdec-8749-49c8-9376-2b44223bd5b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:40.842541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6fb2bdec-8749-49c8-9376-2b44223bd5b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:40.850809 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6fb2bdec-8749-49c8-9376-2b44223bd5b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.152434 Aug 24 05:56:40.851422 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 555/1091] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:40 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:40.992390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3e7b5b7d-a64a-4d6e-aafc-2ecd51ffb993 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:40.992979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3e7b5b7d-a64a-4d6e-aafc-2ecd51ffb993 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:40.999064 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3e7b5b7d-a64a-4d6e-aafc-2ecd51ffb993 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:40.999820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3e7b5b7d-a64a-4d6e-aafc-2ecd51ffb993 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:40.999995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3e7b5b7d-a64a-4d6e-aafc-2ecd51ffb993 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:41.000721 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3e7b5b7d-a64a-4d6e-aafc-2ecd51ffb993 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:41.001185 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3e7b5b7d-a64a-4d6e-aafc-2ecd51ffb993 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:41.001612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3e7b5b7d-a64a-4d6e-aafc-2ecd51ffb993 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:41.141779 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3e7b5b7d-a64a-4d6e-aafc-2ecd51ffb993 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:41.150022 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3e7b5b7d-a64a-4d6e-aafc-2ecd51ffb993 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.162699 Aug 24 05:56:41.150589 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 556/1092] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:40 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:41.487375 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:41.487983 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:41.494786 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:41.495270 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:41.495713 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:41.496427 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:41.496889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:41.497318 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:41.630725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:41.639181 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:41.640718 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:41.641874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-95246fdc-71f8-46e4-8be0-17eb76ecc09d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.158528 Aug 24 05:56:41.642523 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 557/1093] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:41 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:41.872037 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6f46fac4-b1db-4636-9169-afd47d2f5b47 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:41.872704 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6f46fac4-b1db-4636-9169-afd47d2f5b47 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:41.879269 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f46fac4-b1db-4636-9169-afd47d2f5b47 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:41.879756 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f46fac4-b1db-4636-9169-afd47d2f5b47 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:41.880196 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f46fac4-b1db-4636-9169-afd47d2f5b47 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:41.881479 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f46fac4-b1db-4636-9169-afd47d2f5b47 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:41.881479 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f46fac4-b1db-4636-9169-afd47d2f5b47 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:41.881902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6f46fac4-b1db-4636-9169-afd47d2f5b47 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:42.011031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6f46fac4-b1db-4636-9169-afd47d2f5b47 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:42.019546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6f46fac4-b1db-4636-9169-afd47d2f5b47 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.151585 Aug 24 05:56:42.020120 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 558/1094] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:41 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:42.171164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a78e8f55-7d61-4142-92a9-199cace45bdc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:42.171773 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a78e8f55-7d61-4142-92a9-199cace45bdc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:42.178032 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a78e8f55-7d61-4142-92a9-199cace45bdc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:42.178522 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a78e8f55-7d61-4142-92a9-199cace45bdc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:42.179678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a78e8f55-7d61-4142-92a9-199cace45bdc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:42.180499 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a78e8f55-7d61-4142-92a9-199cace45bdc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:42.180967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a78e8f55-7d61-4142-92a9-199cace45bdc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:42.181402 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a78e8f55-7d61-4142-92a9-199cace45bdc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:42.314236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a78e8f55-7d61-4142-92a9-199cace45bdc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:42.321928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a78e8f55-7d61-4142-92a9-199cace45bdc tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.154677 Aug 24 05:56:42.322560 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 559/1095] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:42 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:42.666137 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:42.666786 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:42.672869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:42.673396 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:42.673835 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:42.674798 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:42.675251 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:42.675686 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:42.815025 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:42.823791 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:42.825261 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:42.826417 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-28912809-7705-49b9-bf50-f8e7db8ec1e4 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.165006 Aug 24 05:56:42.826971 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 560/1096] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:42 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:43.041262 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-106650ad-17f8-476b-82da-18a763c4a26b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:43.041900 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-106650ad-17f8-476b-82da-18a763c4a26b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:43.048451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-106650ad-17f8-476b-82da-18a763c4a26b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:43.048945 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-106650ad-17f8-476b-82da-18a763c4a26b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:43.049715 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-106650ad-17f8-476b-82da-18a763c4a26b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:43.050414 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-106650ad-17f8-476b-82da-18a763c4a26b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:43.050875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-106650ad-17f8-476b-82da-18a763c4a26b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:43.051302 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-106650ad-17f8-476b-82da-18a763c4a26b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:43.187911 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-106650ad-17f8-476b-82da-18a763c4a26b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:43.196230 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-106650ad-17f8-476b-82da-18a763c4a26b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.159068 Aug 24 05:56:43.196825 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 561/1097] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:43 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:43.342267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7916f1af-b15b-4adc-a4fc-ebccd131a171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:43.342904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7916f1af-b15b-4adc-a4fc-ebccd131a171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:43.348942 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7916f1af-b15b-4adc-a4fc-ebccd131a171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:43.349429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7916f1af-b15b-4adc-a4fc-ebccd131a171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:43.349867 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7916f1af-b15b-4adc-a4fc-ebccd131a171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:43.351388 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7916f1af-b15b-4adc-a4fc-ebccd131a171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:43.352151 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7916f1af-b15b-4adc-a4fc-ebccd131a171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:43.352619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7916f1af-b15b-4adc-a4fc-ebccd131a171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:43.482844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7916f1af-b15b-4adc-a4fc-ebccd131a171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:43.490511 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7916f1af-b15b-4adc-a4fc-ebccd131a171 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.152129 Aug 24 05:56:43.491107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 562/1098] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:43 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:43.849385 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:43.849897 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:43.856982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:43.857463 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:43.857904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:43.858639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:43.859084 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:43.859510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:43.863450 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:43.988516 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:43.996754 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:43.998256 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:43.999499 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-964e69c2-85db-417d-9c1a-b7cb41c9ceb6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.154146 Aug 24 05:56:44.000060 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 563/1099] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:43 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:44.217150 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e8bdcaf3-62ec-4487-8bbb-eb794acfbc9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:44.217790 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e8bdcaf3-62ec-4487-8bbb-eb794acfbc9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:44.224167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bdcaf3-62ec-4487-8bbb-eb794acfbc9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:44.224685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bdcaf3-62ec-4487-8bbb-eb794acfbc9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:44.225122 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bdcaf3-62ec-4487-8bbb-eb794acfbc9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:44.226367 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bdcaf3-62ec-4487-8bbb-eb794acfbc9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:44.227016 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bdcaf3-62ec-4487-8bbb-eb794acfbc9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:44.227440 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e8bdcaf3-62ec-4487-8bbb-eb794acfbc9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:44.357027 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e8bdcaf3-62ec-4487-8bbb-eb794acfbc9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:44.365265 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e8bdcaf3-62ec-4487-8bbb-eb794acfbc9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.151968 Aug 24 05:56:44.365831 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 564/1100] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:44 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:44.511787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-909b1a0d-2579-4b8e-bead-c6e5522e7b1e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:44.512306 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-909b1a0d-2579-4b8e-bead-c6e5522e7b1e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:44.518579 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-909b1a0d-2579-4b8e-bead-c6e5522e7b1e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:44.519062 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-909b1a0d-2579-4b8e-bead-c6e5522e7b1e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:44.519500 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-909b1a0d-2579-4b8e-bead-c6e5522e7b1e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:44.520189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-909b1a0d-2579-4b8e-bead-c6e5522e7b1e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:44.520694 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-909b1a0d-2579-4b8e-bead-c6e5522e7b1e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:44.521122 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-909b1a0d-2579-4b8e-bead-c6e5522e7b1e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:44.652587 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-909b1a0d-2579-4b8e-bead-c6e5522e7b1e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:44.660320 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-909b1a0d-2579-4b8e-bead-c6e5522e7b1e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.152576 Aug 24 05:56:44.660906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 565/1101] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:44 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:45.022009 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:45.023311 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:45.029254 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:45.029733 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:45.030170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:45.030855 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:45.031305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:45.031722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:45.165635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:45.173829 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:45.175604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:45.176789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f3621165-52e3-4b9c-b0ce-f1d1a67c26e9 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.158731 Aug 24 05:56:45.177351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 566/1102] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:45 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:45.387048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2f4f4389-9288-4530-9f06-5bcf1bb80e97 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:45.387734 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2f4f4389-9288-4530-9f06-5bcf1bb80e97 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:45.393928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2f4f4389-9288-4530-9f06-5bcf1bb80e97 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:45.394417 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2f4f4389-9288-4530-9f06-5bcf1bb80e97 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:45.394852 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2f4f4389-9288-4530-9f06-5bcf1bb80e97 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:45.395544 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2f4f4389-9288-4530-9f06-5bcf1bb80e97 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:45.396004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2f4f4389-9288-4530-9f06-5bcf1bb80e97 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:45.396456 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2f4f4389-9288-4530-9f06-5bcf1bb80e97 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:45.533022 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2f4f4389-9288-4530-9f06-5bcf1bb80e97 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:45.536498 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2f4f4389-9288-4530-9f06-5bcf1bb80e97 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.153389 Aug 24 05:56:45.537067 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 567/1103] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:45 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:45.548995 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=17 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:45.626831 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=76 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:45.681498 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7f739529-93a1-47f2-a59d-bc500be457fe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:45.682014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7f739529-93a1-47f2-a59d-bc500be457fe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:45.688228 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7f739529-93a1-47f2-a59d-bc500be457fe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:45.688737 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7f739529-93a1-47f2-a59d-bc500be457fe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:45.689218 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7f739529-93a1-47f2-a59d-bc500be457fe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:45.689896 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7f739529-93a1-47f2-a59d-bc500be457fe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:45.690341 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7f739529-93a1-47f2-a59d-bc500be457fe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:45.690759 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7f739529-93a1-47f2-a59d-bc500be457fe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:45.826904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7f739529-93a1-47f2-a59d-bc500be457fe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:45.834787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7f739529-93a1-47f2-a59d-bc500be457fe tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.157408 Aug 24 05:56:45.835907 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 568/1104] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:45 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:46.199810 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:46.200468 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:46.206657 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:46.208459 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:46.208459 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:46.208459 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:46.208813 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:46.209174 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:46.341959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:46.350136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:46.351839 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:46.353042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-95855a17-7eb3-476b-a3cc-41922f0d0558 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.157165 Aug 24 05:56:46.353599 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 569/1105] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:46 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:46.559382 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b0dfc726-0c61-4942-b25e-8549080eea1e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:46.560023 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b0dfc726-0c61-4942-b25e-8549080eea1e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:46.566594 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0dfc726-0c61-4942-b25e-8549080eea1e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:46.567078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0dfc726-0c61-4942-b25e-8549080eea1e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:46.567514 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0dfc726-0c61-4942-b25e-8549080eea1e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:46.568207 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0dfc726-0c61-4942-b25e-8549080eea1e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:46.568707 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0dfc726-0c61-4942-b25e-8549080eea1e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:46.569162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0dfc726-0c61-4942-b25e-8549080eea1e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:46.711505 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b0dfc726-0c61-4942-b25e-8549080eea1e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:46.720375 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b0dfc726-0c61-4942-b25e-8549080eea1e tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.164873 Aug 24 05:56:46.721927 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 570/1106] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:46 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:46.856123 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a7434daf-aa52-4ac7-bece-a70eaa4b52d5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:46.856683 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a7434daf-aa52-4ac7-bece-a70eaa4b52d5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:46.862833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7434daf-aa52-4ac7-bece-a70eaa4b52d5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:46.863323 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7434daf-aa52-4ac7-bece-a70eaa4b52d5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:46.863764 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7434daf-aa52-4ac7-bece-a70eaa4b52d5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:46.864472 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7434daf-aa52-4ac7-bece-a70eaa4b52d5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:46.864970 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7434daf-aa52-4ac7-bece-a70eaa4b52d5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:46.865358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7434daf-aa52-4ac7-bece-a70eaa4b52d5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:47.008098 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a7434daf-aa52-4ac7-bece-a70eaa4b52d5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:47.016176 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a7434daf-aa52-4ac7-bece-a70eaa4b52d5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.163903 Aug 24 05:56:47.016834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 571/1107] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:46 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:47.377234 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:47.377836 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:47.384315 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:47.384830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:47.385326 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:47.386011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:47.386468 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:47.386895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:47.517860 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:47.527284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:47.528837 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:47.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2895b391-2e86-4e04-801a-2113e5005157 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.156744 Aug 24 05:56:47.530556 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 572/1108] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:47 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:47.753970 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-060d83bf-b414-4f7f-a3ff-1a1950bce3b5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:47.754653 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-060d83bf-b414-4f7f-a3ff-1a1950bce3b5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:47.762566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-060d83bf-b414-4f7f-a3ff-1a1950bce3b5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:47.763193 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-060d83bf-b414-4f7f-a3ff-1a1950bce3b5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:47.763540 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-060d83bf-b414-4f7f-a3ff-1a1950bce3b5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:47.764297 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-060d83bf-b414-4f7f-a3ff-1a1950bce3b5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:47.764787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-060d83bf-b414-4f7f-a3ff-1a1950bce3b5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:47.765218 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-060d83bf-b414-4f7f-a3ff-1a1950bce3b5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:47.913451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-060d83bf-b414-4f7f-a3ff-1a1950bce3b5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:47.922504 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-060d83bf-b414-4f7f-a3ff-1a1950bce3b5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.173055 Aug 24 05:56:47.923303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 573/1109] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:47 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:48.037796 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-78170c9d-4d3e-4520-88cc-240bedd559a1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:48.038388 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-78170c9d-4d3e-4520-88cc-240bedd559a1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:48.044789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78170c9d-4d3e-4520-88cc-240bedd559a1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:48.045284 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78170c9d-4d3e-4520-88cc-240bedd559a1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:48.045727 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78170c9d-4d3e-4520-88cc-240bedd559a1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:48.046426 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78170c9d-4d3e-4520-88cc-240bedd559a1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:48.046886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78170c9d-4d3e-4520-88cc-240bedd559a1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:48.047316 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78170c9d-4d3e-4520-88cc-240bedd559a1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:48.190122 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-78170c9d-4d3e-4520-88cc-240bedd559a1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:48.198726 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-78170c9d-4d3e-4520-88cc-240bedd559a1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.165461 Aug 24 05:56:48.200875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 574/1110] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:48 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:48.552837 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:48.554001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:48.559965 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:48.560462 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:48.560895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:48.561568 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:48.562014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:48.562460 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:48.704749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:48.713408 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:48.714928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:48.716085 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-53ff5543-fd8f-4209-9abf-f8225626950d tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.167456 Aug 24 05:56:48.716711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 575/1111] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:48 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:48.945428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bdfb9dcc-8a83-495a-bc0a-521d35b1e538 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:48.946120 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bdfb9dcc-8a83-495a-bc0a-521d35b1e538 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:48.952838 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bdfb9dcc-8a83-495a-bc0a-521d35b1e538 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:48.952976 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bdfb9dcc-8a83-495a-bc0a-521d35b1e538 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:48.953380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bdfb9dcc-8a83-495a-bc0a-521d35b1e538 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:48.954064 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bdfb9dcc-8a83-495a-bc0a-521d35b1e538 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:48.954517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bdfb9dcc-8a83-495a-bc0a-521d35b1e538 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:48.954939 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bdfb9dcc-8a83-495a-bc0a-521d35b1e538 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:49.094213 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-bdfb9dcc-8a83-495a-bc0a-521d35b1e538 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:49.102539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bdfb9dcc-8a83-495a-bc0a-521d35b1e538 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1701 microversion: 2.1 time: 0.161469 Aug 24 05:56:49.103111 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 576/1112] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:48 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1701 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:49.122815 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-98f13986-72db-4a08-8fa7-686e4e9f0418 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:49.129967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98f13986-72db-4a08-8fa7-686e4e9f0418 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:49.130457 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98f13986-72db-4a08-8fa7-686e4e9f0418 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:49.130889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-98f13986-72db-4a08-8fa7-686e4e9f0418 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:49.155664 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-98f13986-72db-4a08-8fa7-686e4e9f0418 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Going to try to start instance {{(pid=127756) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 05:56:49.335467 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-98f13986-72db-4a08-8fa7-686e4e9f0418 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "POST /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/action" status: 202 len: 0 microversion: 2.1 time: 0.215981 Aug 24 05:56:49.335974 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 577/1113] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:56:49 2022] POST /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:56:49.341332 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9f6ec36a-d754-45ca-bf7a-4a4e3e58390e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:49.342019 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9f6ec36a-d754-45ca-bf7a-4a4e3e58390e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:49.348283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f6ec36a-d754-45ca-bf7a-4a4e3e58390e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:49.348785 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f6ec36a-d754-45ca-bf7a-4a4e3e58390e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:49.349224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f6ec36a-d754-45ca-bf7a-4a4e3e58390e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:49.349892 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f6ec36a-d754-45ca-bf7a-4a4e3e58390e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:49.350344 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f6ec36a-d754-45ca-bf7a-4a4e3e58390e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:49.350760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9f6ec36a-d754-45ca-bf7a-4a4e3e58390e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:49.483820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9f6ec36a-d754-45ca-bf7a-4a4e3e58390e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:49.487361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:49.493000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9f6ec36a-d754-45ca-bf7a-4a4e3e58390e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.155727 Aug 24 05:56:49.493577 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 578/1114] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:49 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:49.498005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4d26d06b-b6fc-43c6-adc9-9d0608d3fdaa tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:49.500619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4d26d06b-b6fc-43c6-adc9-9d0608d3fdaa tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:49.504328 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d26d06b-b6fc-43c6-adc9-9d0608d3fdaa tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:49.504846 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d26d06b-b6fc-43c6-adc9-9d0608d3fdaa tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:49.505283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d26d06b-b6fc-43c6-adc9-9d0608d3fdaa tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:49.505973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d26d06b-b6fc-43c6-adc9-9d0608d3fdaa tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:49.506434 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d26d06b-b6fc-43c6-adc9-9d0608d3fdaa tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:49.507389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4d26d06b-b6fc-43c6-adc9-9d0608d3fdaa tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:49.648998 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4d26d06b-b6fc-43c6-adc9-9d0608d3fdaa tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:49.656912 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4d26d06b-b6fc-43c6-adc9-9d0608d3fdaa tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1710 microversion: 2.1 time: 0.162362 Aug 24 05:56:49.657479 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 579/1115] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:49 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:49.739128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:49.739772 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:49.746511 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:49.746999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:49.747433 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:49.748155 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:49.748644 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:49.749074 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:49.881186 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:49.889435 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:49.890969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:49.892127 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c307128a-09b6-4286-b29f-8de02020fb3a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.156943 Aug 24 05:56:49.892928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 580/1116] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:49 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:50.514347 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8323c68c-11ec-4351-9fb5-45a61d1921a8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:50.514986 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8323c68c-11ec-4351-9fb5-45a61d1921a8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:50.521346 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8323c68c-11ec-4351-9fb5-45a61d1921a8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:50.521828 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8323c68c-11ec-4351-9fb5-45a61d1921a8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:50.522306 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8323c68c-11ec-4351-9fb5-45a61d1921a8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:50.523024 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8323c68c-11ec-4351-9fb5-45a61d1921a8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:50.523480 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8323c68c-11ec-4351-9fb5-45a61d1921a8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:50.523902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8323c68c-11ec-4351-9fb5-45a61d1921a8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:50.664973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8323c68c-11ec-4351-9fb5-45a61d1921a8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:50.672968 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8323c68c-11ec-4351-9fb5-45a61d1921a8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.162470 Aug 24 05:56:50.673554 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 581/1117] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:50 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:50.680238 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c5e064b4-aa80-4823-ad7c-a51a37dac694 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:50.682278 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c5e064b4-aa80-4823-ad7c-a51a37dac694 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:50.695095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c5e064b4-aa80-4823-ad7c-a51a37dac694 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:50.695598 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c5e064b4-aa80-4823-ad7c-a51a37dac694 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:50.696711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c5e064b4-aa80-4823-ad7c-a51a37dac694 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:50.697447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c5e064b4-aa80-4823-ad7c-a51a37dac694 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:50.697906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c5e064b4-aa80-4823-ad7c-a51a37dac694 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:50.698328 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c5e064b4-aa80-4823-ad7c-a51a37dac694 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:50.838047 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c5e064b4-aa80-4823-ad7c-a51a37dac694 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:50.846344 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c5e064b4-aa80-4823-ad7c-a51a37dac694 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1710 microversion: 2.1 time: 0.171842 Aug 24 05:56:50.846925 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 582/1118] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:50 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1710 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:50.915738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:50.916368 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:50.922327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:50.922807 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:50.923241 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:50.923925 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:50.924657 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:50.925080 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:51.119002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:51.129612 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:51.133893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:51.133893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3482e829-40b2-418e-96d5-978c35b7383a tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.221993 Aug 24 05:56:51.133893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 583/1119] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:50 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:51.571072 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3564b915-ea1b-4192-b042-2dc7a0c95815 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "POST /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.032521 Aug 24 05:56:51.572030 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 537/1120] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 05:56:35 2022] POST /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-volume_attachments => generated 194 bytes in 16034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:51.697677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-60ff15b5-5bde-4a18-9fac-adf7a355024c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:51.697677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-60ff15b5-5bde-4a18-9fac-adf7a355024c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:51.703261 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60ff15b5-5bde-4a18-9fac-adf7a355024c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:51.703805 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60ff15b5-5bde-4a18-9fac-adf7a355024c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:51.704250 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60ff15b5-5bde-4a18-9fac-adf7a355024c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:51.704982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60ff15b5-5bde-4a18-9fac-adf7a355024c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:51.705440 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60ff15b5-5bde-4a18-9fac-adf7a355024c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:51.705916 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60ff15b5-5bde-4a18-9fac-adf7a355024c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:51.846498 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-60ff15b5-5bde-4a18-9fac-adf7a355024c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:51.854264 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-60ff15b5-5bde-4a18-9fac-adf7a355024c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.163187 Aug 24 05:56:51.854823 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 584/1121] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:51 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:51.869490 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-66172cb4-e423-4f07-9c2a-18709fc82933 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:51.870228 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-66172cb4-e423-4f07-9c2a-18709fc82933 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:51.877701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66172cb4-e423-4f07-9c2a-18709fc82933 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:51.880054 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66172cb4-e423-4f07-9c2a-18709fc82933 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:51.880054 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66172cb4-e423-4f07-9c2a-18709fc82933 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:51.880054 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66172cb4-e423-4f07-9c2a-18709fc82933 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:51.880054 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66172cb4-e423-4f07-9c2a-18709fc82933 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:51.880472 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-66172cb4-e423-4f07-9c2a-18709fc82933 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:52.015815 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-66172cb4-e423-4f07-9c2a-18709fc82933 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:52.025944 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-66172cb4-e423-4f07-9c2a-18709fc82933 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1710 microversion: 2.1 time: 0.160813 Aug 24 05:56:52.026712 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 538/1122] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:51 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:52.158752 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:52.159360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:52.165597 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:52.166062 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:52.166501 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:52.167193 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:52.167647 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:52.168073 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:52.296058 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:52.305132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:52.306650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:52.307801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4ae8748a-2719-4c7d-9a91-8fe1ef2fc428 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.153027 Aug 24 05:56:52.308357 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 585/1123] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:52 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:52.874482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-79469a96-7002-4e63-b52d-a496277255b8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:52.875108 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-79469a96-7002-4e63-b52d-a496277255b8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:52.882466 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79469a96-7002-4e63-b52d-a496277255b8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:52.882971 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79469a96-7002-4e63-b52d-a496277255b8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:52.883524 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79469a96-7002-4e63-b52d-a496277255b8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:52.884246 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79469a96-7002-4e63-b52d-a496277255b8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:52.884745 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79469a96-7002-4e63-b52d-a496277255b8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:52.885179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-79469a96-7002-4e63-b52d-a496277255b8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:53.030934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-79469a96-7002-4e63-b52d-a496277255b8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:53.041338 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-79469a96-7002-4e63-b52d-a496277255b8 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1266 microversion: 2.1 time: 0.170706 Aug 24 05:56:53.047475 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a421586f-55a8-4948-9132-cdf25fbf61b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:53.048782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a421586f-55a8-4948-9132-cdf25fbf61b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:53.057176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 539/1124] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:52 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:53.059359 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:53.065561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a421586f-55a8-4948-9132-cdf25fbf61b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:53.066695 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a421586f-55a8-4948-9132-cdf25fbf61b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:53.067330 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a421586f-55a8-4948-9132-cdf25fbf61b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:53.068633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a421586f-55a8-4948-9132-cdf25fbf61b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:53.069296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a421586f-55a8-4948-9132-cdf25fbf61b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:53.069920 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a421586f-55a8-4948-9132-cdf25fbf61b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:53.223097 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a421586f-55a8-4948-9132-cdf25fbf61b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:53.232190 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a421586f-55a8-4948-9132-cdf25fbf61b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1710 microversion: 2.1 time: 0.188775 Aug 24 05:56:53.232796 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 586/1125] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:53 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1710 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:53.331198 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:53.331838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:53.338828 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:53.339314 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:53.339756 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:53.340469 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:53.340978 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:53.341405 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:53.469672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:53.478560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:53.480113 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:53.481303 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-cbe22fcc-3c1e-4d8f-b1e8-2b814416cf49 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.154156 Aug 24 05:56:53.481866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 540/1126] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:53 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:54.065268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-678a335b-e789-4fa5-8446-98ae0ec601de tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:54.065966 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-678a335b-e789-4fa5-8446-98ae0ec601de tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:54.073436 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678a335b-e789-4fa5-8446-98ae0ec601de tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:54.073930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678a335b-e789-4fa5-8446-98ae0ec601de tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:54.074373 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678a335b-e789-4fa5-8446-98ae0ec601de tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:54.075832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678a335b-e789-4fa5-8446-98ae0ec601de tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:54.075832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678a335b-e789-4fa5-8446-98ae0ec601de tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:54.076069 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-678a335b-e789-4fa5-8446-98ae0ec601de tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:54.217677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-678a335b-e789-4fa5-8446-98ae0ec601de tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:54.226055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-678a335b-e789-4fa5-8446-98ae0ec601de tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1452 microversion: 2.1 time: 0.164773 Aug 24 05:56:54.226630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 587/1127] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:54 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:54.247052 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a427cd57-6d88-45c9-8762-08234901436e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:54.247698 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a427cd57-6d88-45c9-8762-08234901436e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:54.253003 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5284c06a-2a52-4ed3-86d5-5a3b59400ada tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:54.253603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5284c06a-2a52-4ed3-86d5-5a3b59400ada tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:54.254233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a427cd57-6d88-45c9-8762-08234901436e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:54.254723 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a427cd57-6d88-45c9-8762-08234901436e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:54.255164 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a427cd57-6d88-45c9-8762-08234901436e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:54.255858 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a427cd57-6d88-45c9-8762-08234901436e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:54.256353 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a427cd57-6d88-45c9-8762-08234901436e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:54.256803 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a427cd57-6d88-45c9-8762-08234901436e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:54.260041 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5284c06a-2a52-4ed3-86d5-5a3b59400ada tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:54.260589 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5284c06a-2a52-4ed3-86d5-5a3b59400ada tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:54.261024 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5284c06a-2a52-4ed3-86d5-5a3b59400ada tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:54.261717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5284c06a-2a52-4ed3-86d5-5a3b59400ada tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:54.262165 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5284c06a-2a52-4ed3-86d5-5a3b59400ada tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:54.262584 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5284c06a-2a52-4ed3-86d5-5a3b59400ada tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:54.710535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a427cd57-6d88-45c9-8762-08234901436e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:54.714546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5284c06a-2a52-4ed3-86d5-5a3b59400ada tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:54.718849 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a427cd57-6d88-45c9-8762-08234901436e tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1452 microversion: 2.1 time: 0.475619 Aug 24 05:56:54.719513 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 541/1128] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:54 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1452 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:54.722725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5284c06a-2a52-4ed3-86d5-5a3b59400ada tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1710 microversion: 2.1 time: 0.473531 Aug 24 05:56:54.723467 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 588/1129] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:54 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1710 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:56:54.724457 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:54.725630 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:54.731568 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:54.732125 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:54.732737 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:54.733528 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:54.734058 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:54.734566 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:54.874018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:54.882782 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:54.884418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:54.885675 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-bd80c6fc-ff8d-4cd7-a7c2-5a396602bb09 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.165173 Aug 24 05:56:54.886322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 542/1130] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:54 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:55.156651 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-7fcd1c97-cbb7-4cfe-ab4c-586f7a092292 req-6065e431-cd4e-448f-8d67-9e1c69cd7c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96fde59-06c5-4305-b87a-9fde71a07588", "name": "network-vif-plugged", "status": "completed", "tag": "d949a0c9-9094-4077-9a1f-391953b800d1"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:55.167589 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-7fcd1c97-cbb7-4cfe-ab4c-586f7a092292 req-6065e431-cd4e-448f-8d67-9e1c69cd7c3c service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:55.168088 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-7fcd1c97-cbb7-4cfe-ab4c-586f7a092292 req-6065e431-cd4e-448f-8d67-9e1c69cd7c3c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:55.168570 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-7fcd1c97-cbb7-4cfe-ab4c-586f7a092292 req-6065e431-cd4e-448f-8d67-9e1c69cd7c3c service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:55.182010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-7fcd1c97-cbb7-4cfe-ab4c-586f7a092292 req-6065e431-cd4e-448f-8d67-9e1c69cd7c3c service nova] Creating event network-vif-plugged:d949a0c9-9094-4077-9a1f-391953b800d1 for instance a96fde59-06c5-4305-b87a-9fde71a07588 on hv-cinder-85426 Aug 24 05:56:55.187513 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-7fcd1c97-cbb7-4cfe-ab4c-586f7a092292 req-6065e431-cd4e-448f-8d67-9e1c69cd7c3c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034608 Aug 24 05:56:55.188141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 589/1131] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:56:55.745140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-028fb212-dd00-418c-9528-2e7221ea66a1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:55.746569 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-028fb212-dd00-418c-9528-2e7221ea66a1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:55.753495 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-028fb212-dd00-418c-9528-2e7221ea66a1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:55.753987 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-028fb212-dd00-418c-9528-2e7221ea66a1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:55.754461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-028fb212-dd00-418c-9528-2e7221ea66a1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:55.755173 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-028fb212-dd00-418c-9528-2e7221ea66a1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:55.755635 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-028fb212-dd00-418c-9528-2e7221ea66a1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:55.756098 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-028fb212-dd00-418c-9528-2e7221ea66a1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:55.909092 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:55.909794 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:55.915038 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-028fb212-dd00-418c-9528-2e7221ea66a1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:55.917077 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:55.917563 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:55.917996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:55.918697 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:55.919146 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:55.919569 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:55.924781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-028fb212-dd00-418c-9528-2e7221ea66a1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1710 microversion: 2.1 time: 0.184717 Aug 24 05:56:55.925578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 543/1132] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:55 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1710 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:56.062345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:56.070981 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:56.073039 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:56.073686 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-fd776e3a-7145-4a32-b95b-d97bfb59ad92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.169115 Aug 24 05:56:56.074246 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 590/1133] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:55 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:56.902120 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-d16d6ae1-ded5-45df-b7f6-27468232de4a req-027609a6-c765-4109-9c01-e7bb01bd61cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930020e6-49a9-488f-870a-1da855b88720", "tag": "05efbf18-2e2f-490b-b7d8-fda19d6de7d8"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:56.912210 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-d16d6ae1-ded5-45df-b7f6-27468232de4a req-027609a6-c765-4109-9c01-e7bb01bd61cc service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:56.913321 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-d16d6ae1-ded5-45df-b7f6-27468232de4a req-027609a6-c765-4109-9c01-e7bb01bd61cc service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:56.914011 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-d16d6ae1-ded5-45df-b7f6-27468232de4a req-027609a6-c765-4109-9c01-e7bb01bd61cc service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:56.926188 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-d16d6ae1-ded5-45df-b7f6-27468232de4a req-027609a6-c765-4109-9c01-e7bb01bd61cc service nova] Creating event network-changed:05efbf18-2e2f-490b-b7d8-fda19d6de7d8 for instance 930020e6-49a9-488f-870a-1da855b88720 on hv-cinder-85426 Aug 24 05:56:56.933312 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-d16d6ae1-ded5-45df-b7f6-27468232de4a req-027609a6-c765-4109-9c01-e7bb01bd61cc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036187 Aug 24 05:56:56.933912 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 544/1134] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:56.947269 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-84f680df-4866-4e26-90a8-694fb16278e7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:56.947950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-84f680df-4866-4e26-90a8-694fb16278e7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:56.954672 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84f680df-4866-4e26-90a8-694fb16278e7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:56.955224 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84f680df-4866-4e26-90a8-694fb16278e7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:56.955668 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84f680df-4866-4e26-90a8-694fb16278e7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:56.956363 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84f680df-4866-4e26-90a8-694fb16278e7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:56.957454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84f680df-4866-4e26-90a8-694fb16278e7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:56.957454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-84f680df-4866-4e26-90a8-694fb16278e7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:57.090949 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-84f680df-4866-4e26-90a8-694fb16278e7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:57.098163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:57.098865 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:57.101157 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-84f680df-4866-4e26-90a8-694fb16278e7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1714 microversion: 2.1 time: 0.157547 Aug 24 05:56:57.112461 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 591/1135] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:56 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:57.112945 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:57.112945 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:57.112945 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:57.112945 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:57.113254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:57.113254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:57.247546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:57.255715 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:57.258094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:57.259268 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d42f2a5b-8e1a-4b11-bbf4-37c11ae051fc tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.165677 Aug 24 05:56:57.259822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 545/1136] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:57 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:56:58.282869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:58.283427 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:58.291443 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:58.291928 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:58.292367 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:58.293082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:58.293540 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:58.293969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:58.422697 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:58.431723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:58.433306 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:58.434487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9a5ef457-7a3d-405a-a149-28f1778890c3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.155620 Aug 24 05:56:58.435049 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 592/1137] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:58 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:56:59.457698 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:59.458335 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:59.465056 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:59.465541 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:59.465976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:59.466674 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:59.467121 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:59.467544 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:59.606998 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:59.615557 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:59.618296 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:59.618473 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6facea1a-014d-4333-bb9f-1b2f30a442ea tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1728 microversion: 2.20 time: 0.164663 Aug 24 05:56:59.618935 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 546/1138] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:56:59 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:57:00.641118 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:00.641762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:00.648523 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:00.649012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:00.649452 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:00.650152 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:00.650637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:00.651065 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:00.784115 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:00.793704 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:00.795232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:00.796408 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a07caf5e-2f6e-4539-82a3-fc8954047481 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1715 microversion: 2.20 time: 0.159277 Aug 24 05:57:00.797056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 593/1139] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:57:00 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:57:01.372775 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9e69cec0-7ad4-4a45-949c-d2acb431a116 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:01.373372 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9e69cec0-7ad4-4a45-949c-d2acb431a116 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:01.379745 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e69cec0-7ad4-4a45-949c-d2acb431a116 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:01.380229 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e69cec0-7ad4-4a45-949c-d2acb431a116 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:01.380702 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e69cec0-7ad4-4a45-949c-d2acb431a116 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:01.381418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e69cec0-7ad4-4a45-949c-d2acb431a116 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:01.381870 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e69cec0-7ad4-4a45-949c-d2acb431a116 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:01.382299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9e69cec0-7ad4-4a45-949c-d2acb431a116 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:01.467200 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-9e69cec0-7ad4-4a45-949c-d2acb431a116 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lazy-loading 'services' on Instance uuid 02332736-ea71-45a8-b925-34196e98d20f {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:57:01.668202 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9e69cec0-7ad4-4a45-949c-d2acb431a116 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-volume_attachments/148835c2-ccd6-4323-aed7-c5616d93ce5d" status: 202 len: 0 microversion: 2.1 time: 0.299161 Aug 24 05:57:01.668771 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 547/1140] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 05:57:01 2022] DELETE /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-volume_attachments/148835c2-ccd6-4323-aed7-c5616d93ce5d => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:57:01.678068 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a99299a9-1a8e-4cad-9722-b0b9d32ab507 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:01.683230 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a99299a9-1a8e-4cad-9722-b0b9d32ab507 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:01.688475 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a99299a9-1a8e-4cad-9722-b0b9d32ab507 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:01.688972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a99299a9-1a8e-4cad-9722-b0b9d32ab507 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:01.689509 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a99299a9-1a8e-4cad-9722-b0b9d32ab507 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:01.690206 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a99299a9-1a8e-4cad-9722-b0b9d32ab507 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:01.690665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a99299a9-1a8e-4cad-9722-b0b9d32ab507 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:01.691089 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a99299a9-1a8e-4cad-9722-b0b9d32ab507 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:01.723530 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a99299a9-1a8e-4cad-9722-b0b9d32ab507 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049968 Aug 24 05:57:01.724100 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 594/1141] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:57:01 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:57:02.736787 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1c552c10-fbaa-4f49-982d-125f69ea74c2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:02.739180 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1c552c10-fbaa-4f49-982d-125f69ea74c2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:02.746489 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1c552c10-fbaa-4f49-982d-125f69ea74c2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:02.746977 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1c552c10-fbaa-4f49-982d-125f69ea74c2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:02.747426 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1c552c10-fbaa-4f49-982d-125f69ea74c2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:02.748131 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1c552c10-fbaa-4f49-982d-125f69ea74c2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:02.748630 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1c552c10-fbaa-4f49-982d-125f69ea74c2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:02.749057 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1c552c10-fbaa-4f49-982d-125f69ea74c2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:02.780016 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1c552c10-fbaa-4f49-982d-125f69ea74c2 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047622 Aug 24 05:57:02.780602 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 548/1142] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:57:02 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:57:03.793076 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5f592652-af41-41dc-8ed5-cf4347f96505 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:03.795248 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5f592652-af41-41dc-8ed5-cf4347f96505 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:03.802313 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5f592652-af41-41dc-8ed5-cf4347f96505 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:03.802892 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5f592652-af41-41dc-8ed5-cf4347f96505 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:03.803924 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5f592652-af41-41dc-8ed5-cf4347f96505 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:03.804667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5f592652-af41-41dc-8ed5-cf4347f96505 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:03.805136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5f592652-af41-41dc-8ed5-cf4347f96505 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:03.805566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5f592652-af41-41dc-8ed5-cf4347f96505 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:03.836979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5f592652-af41-41dc-8ed5-cf4347f96505 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047768 Aug 24 05:57:03.837549 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 595/1143] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 05:57:03 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 05:57:03.902866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-feafbd2a-8f46-4402-80c0-a9bb25067a04 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:03.903306 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-feafbd2a-8f46-4402-80c0-a9bb25067a04 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:03.909825 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-feafbd2a-8f46-4402-80c0-a9bb25067a04 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:03.910305 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-feafbd2a-8f46-4402-80c0-a9bb25067a04 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:03.910734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-feafbd2a-8f46-4402-80c0-a9bb25067a04 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:03.911418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-feafbd2a-8f46-4402-80c0-a9bb25067a04 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:03.911865 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-feafbd2a-8f46-4402-80c0-a9bb25067a04 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:03.912455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-feafbd2a-8f46-4402-80c0-a9bb25067a04 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:03.938730 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-feafbd2a-8f46-4402-80c0-a9bb25067a04 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:57:04.217642 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-feafbd2a-8f46-4402-80c0-a9bb25067a04 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 204 len: 0 microversion: 2.1 time: 0.318458 Aug 24 05:57:04.218242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 549/1144] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:57:03 2022] DELETE /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:57:04.227292 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ad9bc098-8985-408f-8d54-703cdd2f3455 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:04.228026 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ad9bc098-8985-408f-8d54-703cdd2f3455 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:04.234219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad9bc098-8985-408f-8d54-703cdd2f3455 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:04.234691 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad9bc098-8985-408f-8d54-703cdd2f3455 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:04.235122 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad9bc098-8985-408f-8d54-703cdd2f3455 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:04.235803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad9bc098-8985-408f-8d54-703cdd2f3455 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:04.236251 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad9bc098-8985-408f-8d54-703cdd2f3455 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:04.236711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ad9bc098-8985-408f-8d54-703cdd2f3455 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:04.240896 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=100 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:04.370351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ad9bc098-8985-408f-8d54-703cdd2f3455 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:04.378090 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ad9bc098-8985-408f-8d54-703cdd2f3455 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1682 microversion: 2.1 time: 0.155393 Aug 24 05:57:04.378648 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 596/1145] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:04 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:05.400367 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a17acaff-ee36-4c51-98db-46dedfa64bd5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:05.411433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a17acaff-ee36-4c51-98db-46dedfa64bd5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:05.411433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a17acaff-ee36-4c51-98db-46dedfa64bd5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:05.411433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a17acaff-ee36-4c51-98db-46dedfa64bd5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:05.411433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a17acaff-ee36-4c51-98db-46dedfa64bd5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:05.411837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a17acaff-ee36-4c51-98db-46dedfa64bd5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:05.411837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a17acaff-ee36-4c51-98db-46dedfa64bd5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:05.411837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a17acaff-ee36-4c51-98db-46dedfa64bd5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:05.541909 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a17acaff-ee36-4c51-98db-46dedfa64bd5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:05.549857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a17acaff-ee36-4c51-98db-46dedfa64bd5 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1682 microversion: 2.1 time: 0.154107 Aug 24 05:57:05.550422 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 550/1146] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:05 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:06.571818 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e61b25d5-a22c-404a-9c3c-9305d503dce0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:06.572366 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e61b25d5-a22c-404a-9c3c-9305d503dce0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:06.578919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e61b25d5-a22c-404a-9c3c-9305d503dce0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:06.579399 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e61b25d5-a22c-404a-9c3c-9305d503dce0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:06.579837 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e61b25d5-a22c-404a-9c3c-9305d503dce0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:06.580552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e61b25d5-a22c-404a-9c3c-9305d503dce0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:06.581012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e61b25d5-a22c-404a-9c3c-9305d503dce0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:06.581435 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e61b25d5-a22c-404a-9c3c-9305d503dce0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:06.713182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e61b25d5-a22c-404a-9c3c-9305d503dce0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:06.721005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e61b25d5-a22c-404a-9c3c-9305d503dce0 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1682 microversion: 2.1 time: 0.153732 Aug 24 05:57:06.721572 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 597/1147] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:06 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:07.743610 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-07b87990-eadb-4b2e-88fd-43f4ef4e134b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:07.744173 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-07b87990-eadb-4b2e-88fd-43f4ef4e134b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:07.751020 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07b87990-eadb-4b2e-88fd-43f4ef4e134b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:07.751506 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07b87990-eadb-4b2e-88fd-43f4ef4e134b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:07.751943 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07b87990-eadb-4b2e-88fd-43f4ef4e134b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:07.752677 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07b87990-eadb-4b2e-88fd-43f4ef4e134b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:07.753201 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07b87990-eadb-4b2e-88fd-43f4ef4e134b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:07.753629 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-07b87990-eadb-4b2e-88fd-43f4ef4e134b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:07.775535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:07.825267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-07b87990-eadb-4b2e-88fd-43f4ef4e134b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:07.833166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-07b87990-eadb-4b2e-88fd-43f4ef4e134b tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1615 microversion: 2.1 time: 0.093701 Aug 24 05:57:07.833750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 551/1148] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:07 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:08.131860 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-bccf2849-308a-434a-91b8-9c1a7a0d323a req-df4d1023-e5dc-4837-b1b6-3e99134c3d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02332736-ea71-45a8-b925-34196e98d20f", "name": "network-vif-deleted", "tag": "ea01c152-11a1-41f8-89ca-aa117e6edb62"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:57:08.143078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-bccf2849-308a-434a-91b8-9c1a7a0d323a req-df4d1023-e5dc-4837-b1b6-3e99134c3d6a service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:08.143555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-bccf2849-308a-434a-91b8-9c1a7a0d323a req-df4d1023-e5dc-4837-b1b6-3e99134c3d6a service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:08.143989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-bccf2849-308a-434a-91b8-9c1a7a0d323a req-df4d1023-e5dc-4837-b1b6-3e99134c3d6a service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:08.155533 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-bccf2849-308a-434a-91b8-9c1a7a0d323a req-df4d1023-e5dc-4837-b1b6-3e99134c3d6a service nova] Creating event network-vif-deleted:ea01c152-11a1-41f8-89ca-aa117e6edb62 for instance 02332736-ea71-45a8-b925-34196e98d20f on hv-cinder-85426 Aug 24 05:57:08.160787 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-bccf2849-308a-434a-91b8-9c1a7a0d323a req-df4d1023-e5dc-4837-b1b6-3e99134c3d6a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033023 Aug 24 05:57:08.161402 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 598/1149] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:57:08.855390 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:08.856019 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:08.865828 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:08.866326 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:08.866764 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:08.867475 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:08.867975 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:08.868434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:08.920142 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:08.920676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:08.921121 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:08.921615 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lazy-loading 'fault' on Instance uuid 02332736-ea71-45a8-b925-34196e98d20f {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:57:08.968225 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e6e20d5cd44444b43b1e7abb240f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbd03315ded40279308fcc7f0dde7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:08.978058 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-18618b1c-bbad-4d2d-ae41-dae84ecb6953 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 200 len: 1332 microversion: 2.1 time: 0.127141 Aug 24 05:57:08.978554 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 552/1150] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:08 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:10.000183 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:10.000922 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:10.007652 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:10.008132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:10.008606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:10.009299 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:10.009756 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:10.010185 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:10.024303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f HTTP/1.1 Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:57:10.025996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:10.027820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '02332736-ea71-45a8-b925-34196e98d20f'} Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:10.029782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:10.031503 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:10.032948 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:10.032948 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1a6a6301-bd81-435e-a08b-122058332aa7 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 404 len: 111 microversion: 2.1 time: 0.032059 Aug 24 05:57:10.032948 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 599/1151] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:09 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:10.036649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7943ecc6-c13e-4271-8427-bf139909874e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '.version_select at 0x7f064ffc60d0>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:10.041260 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7943ecc6-c13e-4271-8427-bf139909874e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [56afe969-a03b-4324-81cd-d737d481e3df] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:57:11.049645 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [None req-7943ecc6-c13e-4271-8427-bf139909874e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [56afe969-a03b-4324-81cd-d737d481e3df] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 52780. Aug 24 05:57:11.110486 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7943ecc6-c13e-4271-8427-bf139909874e tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627386111" status: 202 len: 0 microversion: 2.1 time: 1.077696 Aug 24 05:57:11.111073 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 553/1152] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 24 05:57:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627386111 => generated 0 bytes in 1079 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:57:13.092350 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:13.092948 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:13.100334 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:13.100846 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:13.101283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:13.101988 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:13.102444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:13.102865 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:13.116654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: DELETE /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f HTTP/1.1 Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:57:13.118226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:13.119863 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '02332736-ea71-45a8-b925-34196e98d20f'} Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:13.120951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:13.122432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:13.124001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:13.124001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-485d0c80-3c5b-4cfa-ae47-45623a1c4afc tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 404 len: 111 microversion: 2.1 time: 0.032332 Aug 24 05:57:13.124001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 600/1153] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:57:13 2022] DELETE /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:13.128634 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:13.129253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 02332736-ea71-45a8-b925-34196e98d20f] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:13.135960 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:13.136471 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:13.136915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:13.137672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:13.138136 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:13.138570 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:13.152692 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f HTTP/1.1 Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:57:13.154380 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:13.156010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '02332736-ea71-45a8-b925-34196e98d20f'} Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:13.156973 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. Aug 24 05:57:13.158546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:13.160645 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 02332736-ea71-45a8-b925-34196e98d20f could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:13.160645 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-15131d74-999c-4bba-8d04-2a62d8b9994a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f" status: 404 len: 111 microversion: 2.1 time: 0.031556 Aug 24 05:57:13.160645 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 554/1154] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:13 2022] GET /compute/v2.1/servers/02332736-ea71-45a8-b925-34196e98d20f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:14.453096 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:14.453592 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:14.460331 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:14.460860 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:14.461298 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:14.462055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:14.462511 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:14.462937 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:14.478643 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: DELETE /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc HTTP/1.1 Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:57:14.480198 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:57:14.481834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '37f911fc-26ef-4d88-a68f-68413310a1dc'} Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:14.482682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:57:14.484268 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.485872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:14.485872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-bca816f6-5e4b-44af-8eca-a34bde333d67 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 404 len: 111 microversion: 2.1 time: 0.032423 Aug 24 05:57:14.485872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 601/1155] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:57:14 2022] DELETE /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:14.491956 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:14.492957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 37f911fc-26ef-4d88-a68f-68413310a1dc] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:14.499320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:14.499807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:14.500255 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:14.501030 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:14.501487 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:14.501918 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:14.515718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc HTTP/1.1 Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:57:14.517382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:57:14.519111 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '37f911fc-26ef-4d88-a68f-68413310a1dc'} Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:14.520104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. Aug 24 05:57:14.521728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.523306 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 37f911fc-26ef-4d88-a68f-68413310a1dc could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:14.523306 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0e6a8881-b4b0-499b-b803-5523a1a1b21a tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc" status: 404 len: 111 microversion: 2.1 time: 0.031371 Aug 24 05:57:14.523306 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 555/1156] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:14 2022] GET /compute/v2.1/servers/37f911fc-26ef-4d88-a68f-68413310a1dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:14.527492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:14.528022 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:14.534021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:14.534504 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:14.534945 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:14.535636 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:14.536092 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:14.536545 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:14.551291 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: DELETE /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 HTTP/1.1 Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:57:14.553989 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:57:14.555637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '7fa31986-0501-4c2b-a261-04ff2fc14bc6'} Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:14.556639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:57:14.557906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.559303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:14.559303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-83d74947-0510-4a49-bd39-5857d28d8b8c tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 404 len: 111 microversion: 2.1 time: 0.031813 Aug 24 05:57:14.559303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 602/1157] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:57:14 2022] DELETE /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:14.563988 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:14.564652 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 7fa31986-0501-4c2b-a261-04ff2fc14bc6] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:14.571218 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:14.571705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:14.572143 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:14.572863 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:14.573328 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:14.573763 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:14.587650 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 HTTP/1.1 Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:57:14.589259 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:57:14.590869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '7fa31986-0501-4c2b-a261-04ff2fc14bc6'} Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:14.591788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. Aug 24 05:57:14.593373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:14.594825 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 7fa31986-0501-4c2b-a261-04ff2fc14bc6 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:14.594825 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a602776d-b98e-4a8b-8e74-3bf42829e322 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6" status: 404 len: 111 microversion: 2.1 time: 0.030452 Aug 24 05:57:14.594825 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 556/1158] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:14 2022] GET /compute/v2.1/servers/7fa31986-0501-4c2b-a261-04ff2fc14bc6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:15.921665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:15.922181 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:15.929264 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:15.929762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:15.930199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:15.930891 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:15.931345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:15.931770 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:15.945339 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: DELETE /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 HTTP/1.1 Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:57:15.946895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:57:15.948528 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '5f94c1e2-6b5c-4d47-bb02-b4c49642dd15'} Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:15.949444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:57:15.950755 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:15.952000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:15.952000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7970e755-bb33-4669-857e-aa5d48a19b90 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 404 len: 111 microversion: 2.1 time: 0.030704 Aug 24 05:57:15.952000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 603/1159] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 05:57:15 2022] DELETE /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:57:15.956924 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:15.957566 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] [instance: 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:15.959876 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:15.964655 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:15.965136 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:15.965576 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:15.966436 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:15.967176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:15.967176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:15.981513 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] HTTP exception thrown: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Request method failure captured: Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 HTTP/1.1 Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbrEaQHV21C7lMUnbsXx8mwueqmLDtI3-5Zz_h5r7W3If0fZicQ5uJ0FWjjPyKNw9ofimTwxuM3vRyDyVUl9eUDxBALDGoDw_gjaOEQJZ9atNnak9s_xOIlUOPsU4iTtahfYDWhfbKMViPeF0xp_xOuZMhPS1dAJyPix97bYV12NjBg Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:57:15.983071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/cfbd03315ded40279308fcc7f0dde7cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/cfbd03315ded40279308fcc7f0dde7cb"}]}] Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: cfbd03315ded40279308fcc7f0dde7cb Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-602403419 Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: d3e6e20d5cd44444b43b1e7abb240f8d Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeNegativeTest-602403419-project Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:57:15.984746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '5f94c1e2-6b5c-4d47-bb02-b4c49642dd15'} Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:15.985700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. Aug 24 05:57:15.987179 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:15.988494 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] Returning 404 to user: Instance 5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:15.988494 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-541c60d7-0a91-4bb3-9cde-8a67b967bab1 tempest-AttachVolumeNegativeTest-602403419 tempest-AttachVolumeNegativeTest-602403419-project] 10.222.0.15 "GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15" status: 404 len: 111 microversion: 2.1 time: 0.031420 Aug 24 05:57:15.988494 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 557/1160] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:15 2022] GET /compute/v2.1/servers/5f94c1e2-6b5c-4d47-bb02-b4c49642dd15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:21.399459 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2bbec4ae-562e-4bf4-a9dd-078aa2de4786 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Action: 'create', calling method: .version_select at 0x7f065c11db80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-886634494", "metadata": {"Type": "work"}}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2bbec4ae-562e-4bf4-a9dd-078aa2de4786 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Request method failure captured: Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 121 Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBb3B_iRbEji2cAynBCyNdzVd2ke7aXe-5sgp5TqtafhHUIA_O7MyPu7ieBHZWOqNnds2tMBAtYpqnHhjcyy9VAb7qv-16PRloth51_I2UX7BrdaLDEfEb6a9XoIXMxEAJWM5LbPRTBw8e9eqA7TZe2BAf_5VGM_l2Kjj8EWYEL8Db_M Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:57:21.415630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}] Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: d0356dbdbc344b9fbf97f636a8919099 Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-886634494", "metadata": {"Type": "work"}}} Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: Aug 24 05:57:21.417345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-886634494', 'metadata': {'Type': 'work'}}}} Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise error Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:21.418273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 05:57:21.420095 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 05:57:21.421614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 05:57:21.421614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.421614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2bbec4ae-562e-4bf4-a9dd-078aa2de4786 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:21.421614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2bbec4ae-562e-4bf4-a9dd-078aa2de4786 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.130317 Aug 24 05:57:21.421614 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 604/1161] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 24 05:57:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:57:21.427830 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9f94a31c-c484-49d9-be7d-1b9d5a939a18 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Action: 'create', calling method: .version_select at 0x7f065cad0160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-271695758", "metadata": {"Type": "work"}}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9f94a31c-c484-49d9-be7d-1b9d5a939a18 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Request method failure captured: Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 119 Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBb3B_iRbEji2cAynBCyNdzVd2ke7aXe-5sgp5TqtafhHUIA_O7MyPu7ieBHZWOqNnds2tMBAtYpqnHhjcyy9VAb7qv-16PRloth51_I2UX7BrdaLDEfEb6a9XoIXMxEAJWM5LbPRTBw8e9eqA7TZe2BAf_5VGM_l2Kjj8EWYEL8Db_M Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:57:21.432611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}] Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: d0356dbdbc344b9fbf97f636a8919099 Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-271695758", "metadata": {"Type": "work"}}} Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: Aug 24 05:57:21.434291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-271695758', 'metadata': {'Type': 'work'}}}} Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise error Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi '0' Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:21.435388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 05:57:21.437242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 05:57:21.445215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 05:57:21.445215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.445215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9f94a31c-c484-49d9-be7d-1b9d5a939a18 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:21.445215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9f94a31c-c484-49d9-be7d-1b9d5a939a18 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011132 Aug 24 05:57:21.445215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 558/1162] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 24 05:57:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:57:21.446312 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-50430177-e5ac-4a8e-a83f-3183349a7622 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Action: 'create', calling method: .version_select at 0x7f065c30ab80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1565943091", "metadata": {"Type": "work"}}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-50430177-e5ac-4a8e-a83f-3183349a7622 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Request method failure captured: Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 119 Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBb3B_iRbEji2cAynBCyNdzVd2ke7aXe-5sgp5TqtafhHUIA_O7MyPu7ieBHZWOqNnds2tMBAtYpqnHhjcyy9VAb7qv-16PRloth51_I2UX7BrdaLDEfEb6a9XoIXMxEAJWM5LbPRTBw8e9eqA7TZe2BAf_5VGM_l2Kjj8EWYEL8Db_M Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:57:21.449919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}] Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: d0356dbdbc344b9fbf97f636a8919099 Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1565943091", "metadata": {"Type": "work"}}} Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: Aug 24 05:57:21.451517 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1565943091', 'metadata': {'Type': 'work'}}}} Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise error Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi '' Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:21.452541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 05:57:21.454219 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 05:57:21.455636 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 05:57:21.455636 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.455636 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-50430177-e5ac-4a8e-a83f-3183349a7622 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:21.455636 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-50430177-e5ac-4a8e-a83f-3183349a7622 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011518 Aug 24 05:57:21.455636 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 605/1163] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 24 05:57:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 05:57:21.465057 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-15542b89-558b-4242-b59f-eb25cf61400c tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Calling method '.version_select at 0x7f065c0e7d30>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:21.495577 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-15542b89-558b-4242-b59f-eb25cf61400c tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] HTTP exception thrown: Volume tempest-invalid-1594804461 could not be found. Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-15542b89-558b-4242-b59f-eb25cf61400c tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Request method failure captured: Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1594804461 HTTP/1.1 Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBb3B_iRbEji2cAynBCyNdzVd2ke7aXe-5sgp5TqtafhHUIA_O7MyPu7ieBHZWOqNnds2tMBAtYpqnHhjcyy9VAb7qv-16PRloth51_I2UX7BrdaLDEfEb6a9XoIXMxEAJWM5LbPRTBw8e9eqA7TZe2BAf_5VGM_l2Kjj8EWYEL8Db_M Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:57:21.497102 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}] Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: d0356dbdbc344b9fbf97f636a8919099 Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Volume tempest-invalid-1594804461 could not be found. Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': 'tempest-invalid-1594804461'} Aug 24 05:57:21.498838 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1594804461 could not be found. (HTTP 404) (Request-ID: req-87b85dba-6c12-4195-add8-b17b94b05702) Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.500086 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:57:21.501622 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1594804461 could not be found. Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:21.503311 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1594804461 could not be found. Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1594804461 could not be found. Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-15542b89-558b-4242-b59f-eb25cf61400c tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Returning 404 to user: Volume tempest-invalid-1594804461 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-15542b89-558b-4242-b59f-eb25cf61400c tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1594804461" status: 404 len: 99 microversion: 2.1 time: 0.038575 Aug 24 05:57:21.505018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 559/1164] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 24 05:57:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1594804461 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:57:21.510072 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c50ef4c5-47b7-48c3-b3be-9d41cb45babe tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004724 Aug 24 05:57:21.510598 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 606/1165] 10.222.0.15 () {58 vars in 1140 bytes} [Wed Aug 24 05:57:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 05:57:21.520628 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ae2aa68b-cccf-4e1e-b4bc-303eec2b1cc9 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004031 Aug 24 05:57:21.521145 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 560/1166] 10.222.0.15 () {58 vars in 1137 bytes} [Wed Aug 24 05:57:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 05:57:21.535595 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-78ef84c2-29f2-44e9-b44a-14ec33f58b65 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Calling method '.version_select at 0x7f065c3ab1f0>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:21.574032 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-78ef84c2-29f2-44e9-b44a-14ec33f58b65 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] HTTP exception thrown: Volume 990dd259-0c0f-436c-8abc-da151fcc5e4d could not be found. Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-78ef84c2-29f2-44e9-b44a-14ec33f58b65 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Request method failure captured: Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: DELETE /compute/v2.1/os-volumes/990dd259-0c0f-436c-8abc-da151fcc5e4d HTTP/1.1 Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBb3B_iRbEji2cAynBCyNdzVd2ke7aXe-5sgp5TqtafhHUIA_O7MyPu7ieBHZWOqNnds2tMBAtYpqnHhjcyy9VAb7qv-16PRloth51_I2UX7BrdaLDEfEb6a9XoIXMxEAJWM5LbPRTBw8e9eqA7TZe2BAf_5VGM_l2Kjj8EWYEL8Db_M Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:57:21.576138 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}] Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: d0356dbdbc344b9fbf97f636a8919099 Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Volume 990dd259-0c0f-436c-8abc-da151fcc5e4d could not be found. Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '990dd259-0c0f-436c-8abc-da151fcc5e4d'} Aug 24 05:57:21.577898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 990dd259-0c0f-436c-8abc-da151fcc5e4d could not be found. (HTTP 404) (Request-ID: req-01be1862-ab41-4bd2-a6fa-2646b73dfeaa) Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.578750 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:57:21.579984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 990dd259-0c0f-436c-8abc-da151fcc5e4d could not be found. Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 05:57:21.581194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 990dd259-0c0f-436c-8abc-da151fcc5e4d could not be found. Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 990dd259-0c0f-436c-8abc-da151fcc5e4d could not be found. Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-78ef84c2-29f2-44e9-b44a-14ec33f58b65 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Returning 404 to user: Volume 990dd259-0c0f-436c-8abc-da151fcc5e4d could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-78ef84c2-29f2-44e9-b44a-14ec33f58b65 tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/990dd259-0c0f-436c-8abc-da151fcc5e4d" status: 404 len: 109 microversion: 2.1 time: 0.051158 Aug 24 05:57:21.582407 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 607/1167] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 24 05:57:21 2022] DELETE /compute/v2.1/os-volumes/990dd259-0c0f-436c-8abc-da151fcc5e4d => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:21.590551 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c1fbb331-ec2b-47de-8972-0be0bb54f53b tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Calling method '.version_select at 0x7f065ca65550>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:21.620321 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-c1fbb331-ec2b-47de-8972-0be0bb54f53b tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] HTTP exception thrown: Volume bd08d628-4d3a-48dd-96bd-af33ca9ebe24 could not be found. Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c1fbb331-ec2b-47de-8972-0be0bb54f53b tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Request method failure captured: Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/os-volumes/bd08d628-4d3a-48dd-96bd-af33ca9ebe24 HTTP/1.1 Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBb3B_iRbEji2cAynBCyNdzVd2ke7aXe-5sgp5TqtafhHUIA_O7MyPu7ieBHZWOqNnds2tMBAtYpqnHhjcyy9VAb7qv-16PRloth51_I2UX7BrdaLDEfEb6a9XoIXMxEAJWM5LbPRTBw8e9eqA7TZe2BAf_5VGM_l2Kjj8EWYEL8Db_M Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:57:21.622479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1176334f605d44d099c58dfe8c6776c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1176334f605d44d099c58dfe8c6776c3"}]}] Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 1176334f605d44d099c58dfe8c6776c3 Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-VolumesNegativeTest-877886973 Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: d0356dbdbc344b9fbf97f636a8919099 Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-VolumesNegativeTest-877886973-project Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Volume bd08d628-4d3a-48dd-96bd-af33ca9ebe24 could not be found. Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': 'bd08d628-4d3a-48dd-96bd-af33ca9ebe24'} Aug 24 05:57:21.624317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd08d628-4d3a-48dd-96bd-af33ca9ebe24 could not be found. (HTTP 404) (Request-ID: req-715dc14b-f76b-444e-afbd-b5888ab04df0) Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.625297 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:57:21.626637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd08d628-4d3a-48dd-96bd-af33ca9ebe24 could not be found. Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 05:57:21.628967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd08d628-4d3a-48dd-96bd-af33ca9ebe24 could not be found. Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd08d628-4d3a-48dd-96bd-af33ca9ebe24 could not be found. Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c1fbb331-ec2b-47de-8972-0be0bb54f53b tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] Returning 404 to user: Volume bd08d628-4d3a-48dd-96bd-af33ca9ebe24 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c1fbb331-ec2b-47de-8972-0be0bb54f53b tempest-VolumesNegativeTest-877886973 tempest-VolumesNegativeTest-877886973-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/bd08d628-4d3a-48dd-96bd-af33ca9ebe24" status: 404 len: 109 microversion: 2.1 time: 0.038853 Aug 24 05:57:21.630957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 561/1168] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 24 05:57:21 2022] GET /compute/v2.1/os-volumes/bd08d628-4d3a-48dd-96bd-af33ca9ebe24 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:58:58.744734 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=34 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:58.745493 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=22 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:58.750000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1439865155", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "networks": [{"uuid": "8e4d81d0-5c97-44ce-8527-aee49bb9fb6b"}]}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:58:58.810274 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.network.neutron [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] validate_networks() for [('8e4d81d0-5c97-44ce-8527-aee49bb9fb6b', None, None, None, None, None)] {{(pid=127756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:58:59.208638 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Flavor limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:58:59.209057 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Image limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:58:59.209521 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Flavor pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:58:59.209924 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Image pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:58:59.210328 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:58:59.219161 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:58:59.219634 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:58:59.224046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:58:59.224046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:58:59.224046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:58:59.224046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:58:59.238803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Getting quotas for project 4c6ba7a7881546eea41c15fa4c6e0244. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:58:59.242774 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Getting quotas for user 89b5395d46bf4d55bbce8e30198eab6d and project 4c6ba7a7881546eea41c15fa4c6e0244. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:58:59.254166 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Going to run 1 instances... {{(pid=127756) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:58:59.256429 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:58:59.389477 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0c88ad54-086b-4f2f-82ef-d46280e14887 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646874 Aug 24 05:58:59.390148 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 608/1169] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 05:58:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:58:59.400242 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e14e250-c149-4abc-b494-ae3c994482c3] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:58:59.400813 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=18 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:58:59.405869 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c609cc14-89b0-4e77-86d5-f3d97992a704 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:58:59.406526 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c609cc14-89b0-4e77-86d5-f3d97992a704 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:58:59.464999 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c609cc14-89b0-4e77-86d5-f3d97992a704 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:58:59.473252 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c609cc14-89b0-4e77-86d5-f3d97992a704 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1219 microversion: 2.1 time: 0.074753 Aug 24 05:58:59.473822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 562/1170] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:58:59 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:00.493953 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2df06d2b-ef27-4132-bc36-b201e0b286f4 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:00.494555 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2df06d2b-ef27-4132-bc36-b201e0b286f4 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:00.502518 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2df06d2b-ef27-4132-bc36-b201e0b286f4 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:00.503139 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2df06d2b-ef27-4132-bc36-b201e0b286f4 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:00.503590 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2df06d2b-ef27-4132-bc36-b201e0b286f4 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:00.504294 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2df06d2b-ef27-4132-bc36-b201e0b286f4 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:00.504782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2df06d2b-ef27-4132-bc36-b201e0b286f4 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:00.505217 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2df06d2b-ef27-4132-bc36-b201e0b286f4 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:00.570997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2df06d2b-ef27-4132-bc36-b201e0b286f4 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:00.578936 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2df06d2b-ef27-4132-bc36-b201e0b286f4 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1223 microversion: 2.1 time: 0.089012 Aug 24 05:59:00.583181 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 609/1171] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:00 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:01.600322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-75e4b95b-60d2-47aa-abf5-ea3712e1a68a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:01.600906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-75e4b95b-60d2-47aa-abf5-ea3712e1a68a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:01.609696 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-75e4b95b-60d2-47aa-abf5-ea3712e1a68a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:01.613094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-75e4b95b-60d2-47aa-abf5-ea3712e1a68a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:01.613094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-75e4b95b-60d2-47aa-abf5-ea3712e1a68a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:01.613094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-75e4b95b-60d2-47aa-abf5-ea3712e1a68a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:01.613094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-75e4b95b-60d2-47aa-abf5-ea3712e1a68a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:01.613665 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-75e4b95b-60d2-47aa-abf5-ea3712e1a68a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:01.619222 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e14e250-c149-4abc-b494-ae3c994482c3] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 53544. Aug 24 05:59:01.682733 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-75e4b95b-60d2-47aa-abf5-ea3712e1a68a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:01.691631 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-75e4b95b-60d2-47aa-abf5-ea3712e1a68a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1279 microversion: 2.1 time: 0.095885 Aug 24 05:59:01.692553 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 563/1172] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:01 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:02.712837 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-23f25bea-c674-41de-8f14-237cfe136d1b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:02.713519 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-23f25bea-c674-41de-8f14-237cfe136d1b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:02.722048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-23f25bea-c674-41de-8f14-237cfe136d1b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:02.722477 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-23f25bea-c674-41de-8f14-237cfe136d1b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:02.722901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-23f25bea-c674-41de-8f14-237cfe136d1b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:02.723622 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-23f25bea-c674-41de-8f14-237cfe136d1b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:02.724083 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-23f25bea-c674-41de-8f14-237cfe136d1b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:02.724546 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-23f25bea-c674-41de-8f14-237cfe136d1b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:02.859315 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-23f25bea-c674-41de-8f14-237cfe136d1b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:02.868271 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-23f25bea-c674-41de-8f14-237cfe136d1b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1319 microversion: 2.1 time: 0.159546 Aug 24 05:59:02.868907 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 610/1173] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:02 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:03.188064 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-6af4db4e-796a-4c6c-8b6a-9c13b17be64b req-a9a176b2-6231-4566-b347-f1f753ef6c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1056162-0a25-4f9a-878f-4cd2beba5939", "tag": "c7cb7a1a-af2f-493e-a98f-f1a5d64bcfe2"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:59:03.199236 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-6af4db4e-796a-4c6c-8b6a-9c13b17be64b req-a9a176b2-6231-4566-b347-f1f753ef6c2d service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:03.199713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-6af4db4e-796a-4c6c-8b6a-9c13b17be64b req-a9a176b2-6231-4566-b347-f1f753ef6c2d service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:03.200151 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-6af4db4e-796a-4c6c-8b6a-9c13b17be64b req-a9a176b2-6231-4566-b347-f1f753ef6c2d service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:03.211184 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-6af4db4e-796a-4c6c-8b6a-9c13b17be64b req-a9a176b2-6231-4566-b347-f1f753ef6c2d service nova] Creating event network-changed:c7cb7a1a-af2f-493e-a98f-f1a5d64bcfe2 for instance c1056162-0a25-4f9a-878f-4cd2beba5939 on hv-cinder-85426 Aug 24 05:59:03.216418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-6af4db4e-796a-4c6c-8b6a-9c13b17be64b req-a9a176b2-6231-4566-b347-f1f753ef6c2d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033123 Aug 24 05:59:03.217160 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 564/1174] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:59:03.890101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-24be1f20-62a0-460a-af68-9eaf35905561 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:03.890714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-24be1f20-62a0-460a-af68-9eaf35905561 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:03.897965 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-24be1f20-62a0-460a-af68-9eaf35905561 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:03.898451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-24be1f20-62a0-460a-af68-9eaf35905561 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:03.898891 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-24be1f20-62a0-460a-af68-9eaf35905561 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:03.899586 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-24be1f20-62a0-460a-af68-9eaf35905561 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:03.900038 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-24be1f20-62a0-460a-af68-9eaf35905561 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:03.900490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-24be1f20-62a0-460a-af68-9eaf35905561 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:04.036751 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-24be1f20-62a0-460a-af68-9eaf35905561 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:04.044604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-24be1f20-62a0-460a-af68-9eaf35905561 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1319 microversion: 2.1 time: 0.158318 Aug 24 05:59:04.045173 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 611/1175] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:03 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:05.068213 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-bbbcbda5-592c-42e8-a74d-151aa65a97ee tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:05.068988 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-bbbcbda5-592c-42e8-a74d-151aa65a97ee tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:05.075668 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbbcbda5-592c-42e8-a74d-151aa65a97ee tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:05.076156 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbbcbda5-592c-42e8-a74d-151aa65a97ee tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:05.076640 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbbcbda5-592c-42e8-a74d-151aa65a97ee tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:05.077342 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbbcbda5-592c-42e8-a74d-151aa65a97ee tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:05.077806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbbcbda5-592c-42e8-a74d-151aa65a97ee tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:05.078241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbbcbda5-592c-42e8-a74d-151aa65a97ee tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:05.213743 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-bbbcbda5-592c-42e8-a74d-151aa65a97ee tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:05.221939 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-bbbcbda5-592c-42e8-a74d-151aa65a97ee tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1319 microversion: 2.1 time: 0.159093 Aug 24 05:59:05.222517 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 565/1176] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:05 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:06.245687 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-52c4131f-e41d-496b-81ad-50f847fa02aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:06.245687 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-52c4131f-e41d-496b-81ad-50f847fa02aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:06.250304 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-52c4131f-e41d-496b-81ad-50f847fa02aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:06.250788 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-52c4131f-e41d-496b-81ad-50f847fa02aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:06.251229 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-52c4131f-e41d-496b-81ad-50f847fa02aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:06.253056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-52c4131f-e41d-496b-81ad-50f847fa02aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:06.253521 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-52c4131f-e41d-496b-81ad-50f847fa02aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:06.253952 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-52c4131f-e41d-496b-81ad-50f847fa02aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:06.396141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-52c4131f-e41d-496b-81ad-50f847fa02aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:06.403995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-52c4131f-e41d-496b-81ad-50f847fa02aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1319 microversion: 2.1 time: 0.164728 Aug 24 05:59:06.404576 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 612/1177] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:06 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:07.424716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-fb5f65fd-585b-464b-8140-e0ff47ed2a8d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:07.425338 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-fb5f65fd-585b-464b-8140-e0ff47ed2a8d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:07.432050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5f65fd-585b-464b-8140-e0ff47ed2a8d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:07.432562 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5f65fd-585b-464b-8140-e0ff47ed2a8d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:07.433002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5f65fd-585b-464b-8140-e0ff47ed2a8d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:07.433685 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5f65fd-585b-464b-8140-e0ff47ed2a8d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:07.434141 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5f65fd-585b-464b-8140-e0ff47ed2a8d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:07.434565 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fb5f65fd-585b-464b-8140-e0ff47ed2a8d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:07.571610 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fb5f65fd-585b-464b-8140-e0ff47ed2a8d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:07.579234 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-fb5f65fd-585b-464b-8140-e0ff47ed2a8d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1319 microversion: 2.1 time: 0.158674 Aug 24 05:59:07.580392 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 566/1178] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:07 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:08.601800 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0bbd9c3a-77b7-497a-ae4c-e92a8a95d495 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:08.602487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0bbd9c3a-77b7-497a-ae4c-e92a8a95d495 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:08.609032 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0bbd9c3a-77b7-497a-ae4c-e92a8a95d495 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:08.609512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0bbd9c3a-77b7-497a-ae4c-e92a8a95d495 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:08.609951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0bbd9c3a-77b7-497a-ae4c-e92a8a95d495 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:08.611158 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0bbd9c3a-77b7-497a-ae4c-e92a8a95d495 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:08.611981 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0bbd9c3a-77b7-497a-ae4c-e92a8a95d495 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:08.612277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0bbd9c3a-77b7-497a-ae4c-e92a8a95d495 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:08.743304 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0bbd9c3a-77b7-497a-ae4c-e92a8a95d495 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:08.751148 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0bbd9c3a-77b7-497a-ae4c-e92a8a95d495 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1319 microversion: 2.1 time: 0.153258 Aug 24 05:59:08.752302 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 613/1179] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:08 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:09.773759 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ed9aff43-394f-44d2-9c07-99fbac87e8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:09.774406 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ed9aff43-394f-44d2-9c07-99fbac87e8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:09.777146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:09.782075 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed9aff43-394f-44d2-9c07-99fbac87e8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:09.782579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed9aff43-394f-44d2-9c07-99fbac87e8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:09.783328 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed9aff43-394f-44d2-9c07-99fbac87e8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:09.784147 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed9aff43-394f-44d2-9c07-99fbac87e8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:09.784659 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed9aff43-394f-44d2-9c07-99fbac87e8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:09.785099 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ed9aff43-394f-44d2-9c07-99fbac87e8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:09.933040 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ed9aff43-394f-44d2-9c07-99fbac87e8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:09.942619 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ed9aff43-394f-44d2-9c07-99fbac87e8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1319 microversion: 2.1 time: 0.172529 Aug 24 05:59:09.943680 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 567/1180] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:09 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:10.967824 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-22b0f77d-52e3-451e-ba1d-6e3f795c5aab tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:10.968508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-22b0f77d-52e3-451e-ba1d-6e3f795c5aab tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:10.971726 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:10.972425 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=6 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:10.978110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-22b0f77d-52e3-451e-ba1d-6e3f795c5aab tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:10.978602 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-22b0f77d-52e3-451e-ba1d-6e3f795c5aab tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:10.979089 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-22b0f77d-52e3-451e-ba1d-6e3f795c5aab tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:10.979836 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-22b0f77d-52e3-451e-ba1d-6e3f795c5aab tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:10.980305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-22b0f77d-52e3-451e-ba1d-6e3f795c5aab tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:10.980761 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-22b0f77d-52e3-451e-ba1d-6e3f795c5aab tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:11.116715 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-22b0f77d-52e3-451e-ba1d-6e3f795c5aab tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:11.124420 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-22b0f77d-52e3-451e-ba1d-6e3f795c5aab tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1319 microversion: 2.1 time: 0.160603 Aug 24 05:59:11.125212 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 614/1181] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:10 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:11.848335 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-070b44a0-4ce8-4ad5-aff5-8e5e9dac193c req-b83dfd7f-9e0c-41e6-89a3-5dc0a8bc3142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1056162-0a25-4f9a-878f-4cd2beba5939", "name": "network-vif-plugged", "status": "completed", "tag": "c7cb7a1a-af2f-493e-a98f-f1a5d64bcfe2"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:59:11.858377 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-070b44a0-4ce8-4ad5-aff5-8e5e9dac193c req-b83dfd7f-9e0c-41e6-89a3-5dc0a8bc3142 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:11.858888 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-070b44a0-4ce8-4ad5-aff5-8e5e9dac193c req-b83dfd7f-9e0c-41e6-89a3-5dc0a8bc3142 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:11.859313 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-070b44a0-4ce8-4ad5-aff5-8e5e9dac193c req-b83dfd7f-9e0c-41e6-89a3-5dc0a8bc3142 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:11.870792 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-070b44a0-4ce8-4ad5-aff5-8e5e9dac193c req-b83dfd7f-9e0c-41e6-89a3-5dc0a8bc3142 service nova] Creating event network-vif-plugged:c7cb7a1a-af2f-493e-a98f-f1a5d64bcfe2 for instance c1056162-0a25-4f9a-878f-4cd2beba5939 on hv-cinder-85426 Aug 24 05:59:11.875850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-070b44a0-4ce8-4ad5-aff5-8e5e9dac193c req-b83dfd7f-9e0c-41e6-89a3-5dc0a8bc3142 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031941 Aug 24 05:59:11.876496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 568/1182] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:59:12.099653 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:12.100238 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:12.106258 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:12.106739 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:12.107177 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:12.107983 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:12.108457 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:12.108896 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:12.147310 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a706ed11-f166-4090-b0d9-e95429d94fe7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:12.148238 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a706ed11-f166-4090-b0d9-e95429d94fe7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:12.158334 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a706ed11-f166-4090-b0d9-e95429d94fe7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:12.158959 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a706ed11-f166-4090-b0d9-e95429d94fe7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:12.159394 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a706ed11-f166-4090-b0d9-e95429d94fe7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:12.160099 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a706ed11-f166-4090-b0d9-e95429d94fe7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:12.160582 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a706ed11-f166-4090-b0d9-e95429d94fe7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:12.161008 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a706ed11-f166-4090-b0d9-e95429d94fe7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:12.215168 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lazy-loading 'services' on Instance uuid 21cccbf8-b418-4977-900d-f4b1fa91d277 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:59:12.309690 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a706ed11-f166-4090-b0d9-e95429d94fe7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:12.318355 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a706ed11-f166-4090-b0d9-e95429d94fe7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1319 microversion: 2.1 time: 0.176533 Aug 24 05:59:12.318979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 569/1183] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:12 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:59:12.418367 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [be06d243-7e45-49c5-8f2e-2d096996a717] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:59:13.339292 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9108c679-4609-4306-a658-8a63fd9f4eef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:13.339912 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9108c679-4609-4306-a658-8a63fd9f4eef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:13.347483 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9108c679-4609-4306-a658-8a63fd9f4eef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:13.347972 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9108c679-4609-4306-a658-8a63fd9f4eef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:13.348461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9108c679-4609-4306-a658-8a63fd9f4eef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:13.349164 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9108c679-4609-4306-a658-8a63fd9f4eef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:13.349628 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9108c679-4609-4306-a658-8a63fd9f4eef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:13.350059 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9108c679-4609-4306-a658-8a63fd9f4eef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:13.428157 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [be06d243-7e45-49c5-8f2e-2d096996a717] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 53584. Aug 24 05:59:13.432738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a7e8b7ef-4e70-4ea0-bc19-d4852c54d075 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "DELETE /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/os-volume_attachments/f9db6c80-01d1-48f1-a071-1016fa6c3866" status: 202 len: 0 microversion: 2.1 time: 1.526559 Aug 24 05:59:13.433333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 615/1184] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 05:59:11 2022] DELETE /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/os-volume_attachments/f9db6c80-01d1-48f1-a071-1016fa6c3866 => generated 0 bytes in 1528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:59:13.483547 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9108c679-4609-4306-a658-8a63fd9f4eef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:13.494559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9108c679-4609-4306-a658-8a63fd9f4eef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1319 microversion: 2.1 time: 0.159063 Aug 24 05:59:13.495425 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 570/1185] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:13 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:59:14.517340 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1f14abef-045c-4005-9b3c-0d3148a301aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:14.517969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1f14abef-045c-4005-9b3c-0d3148a301aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:14.524464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f14abef-045c-4005-9b3c-0d3148a301aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:14.524961 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f14abef-045c-4005-9b3c-0d3148a301aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:14.525400 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f14abef-045c-4005-9b3c-0d3148a301aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:14.526101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f14abef-045c-4005-9b3c-0d3148a301aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:14.526560 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f14abef-045c-4005-9b3c-0d3148a301aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:14.526990 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1f14abef-045c-4005-9b3c-0d3148a301aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:14.666764 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1f14abef-045c-4005-9b3c-0d3148a301aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:14.674938 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1f14abef-045c-4005-9b3c-0d3148a301aa tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1508 microversion: 2.1 time: 0.162610 Aug 24 05:59:14.675507 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 616/1186] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:14 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:14.813181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9bcfc696-ea30-441e-aa5c-cf005289bb18 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:14.815480 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9bcfc696-ea30-441e-aa5c-cf005289bb18 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:14.822201 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bcfc696-ea30-441e-aa5c-cf005289bb18 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:14.822693 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bcfc696-ea30-441e-aa5c-cf005289bb18 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:14.823140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bcfc696-ea30-441e-aa5c-cf005289bb18 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:14.823848 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bcfc696-ea30-441e-aa5c-cf005289bb18 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:14.824314 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bcfc696-ea30-441e-aa5c-cf005289bb18 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:14.824777 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bcfc696-ea30-441e-aa5c-cf005289bb18 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:14.855927 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9bcfc696-ea30-441e-aa5c-cf005289bb18 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046636 Aug 24 05:59:14.856522 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 571/1187] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 24 05:59:14 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:14.919610 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-46c704b7-0955-4f40-a0da-4006b020ec89 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:14.920111 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-46c704b7-0955-4f40-a0da-4006b020ec89 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:14.926672 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-46c704b7-0955-4f40-a0da-4006b020ec89 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:14.927150 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-46c704b7-0955-4f40-a0da-4006b020ec89 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:14.927579 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-46c704b7-0955-4f40-a0da-4006b020ec89 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:14.928267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-46c704b7-0955-4f40-a0da-4006b020ec89 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:14.928743 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-46c704b7-0955-4f40-a0da-4006b020ec89 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:14.929159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-46c704b7-0955-4f40-a0da-4006b020ec89 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:14.961543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-46c704b7-0955-4f40-a0da-4006b020ec89 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Going to try to terminate instance {{(pid=127756) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:59:15.290762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-46c704b7-0955-4f40-a0da-4006b020ec89 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 204 len: 0 microversion: 2.20 time: 0.373462 Aug 24 05:59:15.290762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 617/1188] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 24 05:59:14 2022] DELETE /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:59:15.301648 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:15.303097 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:15.311612 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:15.312107 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:15.312587 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:15.313294 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:15.313761 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:15.315052 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:15.487850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:15.499155 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:15.500790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:15.502596 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b04dc0f0-6ff2-4129-b22a-22e2136e8408 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.207630 Aug 24 05:59:15.503241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 572/1189] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:59:15 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:59:15.638997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1a4ed36b-e2f6-429a-a26c-36cb3805fdf9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:59:15.649876 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a4ed36b-e2f6-429a-a26c-36cb3805fdf9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:15.650375 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a4ed36b-e2f6-429a-a26c-36cb3805fdf9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:15.650827 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1a4ed36b-e2f6-429a-a26c-36cb3805fdf9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:15.678799 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1a4ed36b-e2f6-429a-a26c-36cb3805fdf9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Going to try to stop instance {{(pid=127756) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 05:59:15.894593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1a4ed36b-e2f6-429a-a26c-36cb3805fdf9 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "POST /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/action" status: 202 len: 0 microversion: 2.1 time: 0.262865 Aug 24 05:59:15.895692 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 618/1190] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:59:15 2022] POST /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:59:15.910706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1da2230b-9de1-4d34-8b0c-524e17321423 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:15.911192 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1da2230b-9de1-4d34-8b0c-524e17321423 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:15.919705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1da2230b-9de1-4d34-8b0c-524e17321423 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:15.920200 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1da2230b-9de1-4d34-8b0c-524e17321423 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:15.920663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1da2230b-9de1-4d34-8b0c-524e17321423 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:15.921414 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1da2230b-9de1-4d34-8b0c-524e17321423 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:15.921872 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1da2230b-9de1-4d34-8b0c-524e17321423 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:15.922302 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1da2230b-9de1-4d34-8b0c-524e17321423 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:16.088757 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1da2230b-9de1-4d34-8b0c-524e17321423 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:16.099635 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1da2230b-9de1-4d34-8b0c-524e17321423 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1724 microversion: 2.1 time: 0.194780 Aug 24 05:59:16.100219 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 573/1191] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:15 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:16.527868 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:16.528604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:16.534984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:16.535468 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:16.536013 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:16.536779 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:16.537301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:16.537835 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:16.692688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:16.701291 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:16.702886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:16.704105 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7573c3d5-f0be-46b4-b1b3-008ab91c5e92 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.180612 Aug 24 05:59:16.705288 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 619/1192] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:59:16 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:59:17.130554 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-860d8a54-c943-43ef-9046-54f40f32a8df tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:17.131695 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-860d8a54-c943-43ef-9046-54f40f32a8df tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:17.138899 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-860d8a54-c943-43ef-9046-54f40f32a8df tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:17.139386 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-860d8a54-c943-43ef-9046-54f40f32a8df tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:17.139816 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-860d8a54-c943-43ef-9046-54f40f32a8df tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:17.140556 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-860d8a54-c943-43ef-9046-54f40f32a8df tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:17.141007 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-860d8a54-c943-43ef-9046-54f40f32a8df tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:17.141446 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-860d8a54-c943-43ef-9046-54f40f32a8df tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:17.273393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-860d8a54-c943-43ef-9046-54f40f32a8df tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:17.281214 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-860d8a54-c943-43ef-9046-54f40f32a8df tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.155788 Aug 24 05:59:17.281784 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 574/1193] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:17 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:17.729041 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:17.729041 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:17.736548 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:17.737446 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:17.738007 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:17.738740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:17.739199 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:17.739632 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:17.875167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:17.884385 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:17.886002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:17.887175 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9513cfd0-c632-43fd-a610-b11efb00da29 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1721 microversion: 2.20 time: 0.163095 Aug 24 05:59:17.887748 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 620/1194] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:59:17 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:59:18.302760 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e71fe9a4-cf0c-486c-b7ba-88c771f00b13 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:18.303361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e71fe9a4-cf0c-486c-b7ba-88c771f00b13 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:18.309913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e71fe9a4-cf0c-486c-b7ba-88c771f00b13 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:18.310404 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e71fe9a4-cf0c-486c-b7ba-88c771f00b13 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:18.310851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e71fe9a4-cf0c-486c-b7ba-88c771f00b13 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:18.311561 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e71fe9a4-cf0c-486c-b7ba-88c771f00b13 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:18.312015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e71fe9a4-cf0c-486c-b7ba-88c771f00b13 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:18.312467 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e71fe9a4-cf0c-486c-b7ba-88c771f00b13 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:18.455610 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e71fe9a4-cf0c-486c-b7ba-88c771f00b13 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:18.465711 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e71fe9a4-cf0c-486c-b7ba-88c771f00b13 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.167553 Aug 24 05:59:18.468017 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 575/1195] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:18 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:18.911603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:18.912147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:18.919057 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:18.919850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:18.920295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:18.921033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:18.921494 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:18.921926 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:19.016554 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:19.021744 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:19.027930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:19.029488 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:19.030677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-71691dec-9bfc-4de9-ac20-63ae0a1cebe6 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1653 microversion: 2.20 time: 0.123946 Aug 24 05:59:19.035947 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 621/1196] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:59:18 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1653 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:59:19.159302 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-aeb05598-7ea2-494c-bd93-d6d250bba37e req-c7721aeb-2b14-4e39-8549-49f6bd3023d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96fde59-06c5-4305-b87a-9fde71a07588", "name": "network-vif-deleted", "tag": "d949a0c9-9094-4077-9a1f-391953b800d1"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:59:19.173817 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-aeb05598-7ea2-494c-bd93-d6d250bba37e req-c7721aeb-2b14-4e39-8549-49f6bd3023d7 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:19.173817 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-aeb05598-7ea2-494c-bd93-d6d250bba37e req-c7721aeb-2b14-4e39-8549-49f6bd3023d7 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:19.173817 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-aeb05598-7ea2-494c-bd93-d6d250bba37e req-c7721aeb-2b14-4e39-8549-49f6bd3023d7 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:19.191119 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-aeb05598-7ea2-494c-bd93-d6d250bba37e req-c7721aeb-2b14-4e39-8549-49f6bd3023d7 service nova] Creating event network-vif-deleted:d949a0c9-9094-4077-9a1f-391953b800d1 for instance a96fde59-06c5-4305-b87a-9fde71a07588 on hv-cinder-85426 Aug 24 05:59:19.196241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-aeb05598-7ea2-494c-bd93-d6d250bba37e req-c7721aeb-2b14-4e39-8549-49f6bd3023d7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040796 Aug 24 05:59:19.196822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 576/1197] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 05:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:59:19.492347 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d351cbd9-aec5-467d-be25-7310816bd710 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:19.493410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d351cbd9-aec5-467d-be25-7310816bd710 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:19.500356 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d351cbd9-aec5-467d-be25-7310816bd710 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:19.500881 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d351cbd9-aec5-467d-be25-7310816bd710 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:19.501379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d351cbd9-aec5-467d-be25-7310816bd710 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:19.502189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d351cbd9-aec5-467d-be25-7310816bd710 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:19.502706 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d351cbd9-aec5-467d-be25-7310816bd710 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:19.503424 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d351cbd9-aec5-467d-be25-7310816bd710 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:19.659635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d351cbd9-aec5-467d-be25-7310816bd710 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:19.667510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d351cbd9-aec5-467d-be25-7310816bd710 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.179128 Aug 24 05:59:19.681481 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 622/1198] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:19 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:20.057082 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:20.061460 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:20.064926 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:20.065174 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:20.065708 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:20.066480 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:20.067018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:20.067533 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:20.105393 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:20.105978 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:20.106484 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:20.107036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lazy-loading 'fault' on Instance uuid a96fde59-06c5-4305-b87a-9fde71a07588 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:59:20.154216 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:20.169494 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:20.171689 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ef3bf8dfd342f5a2fef02bf597af90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbd96812654d16bbcf3522574a67eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:20.174635 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-67c259cf-5ded-4f42-ac66-4e316ca1ec8c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 200 len: 1371 microversion: 2.20 time: 0.121601 Aug 24 05:59:20.180704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 577/1199] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:59:20 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 1371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:59:20.692343 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2a100f04-696b-45a6-b01d-73bc061881c1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:20.693151 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2a100f04-696b-45a6-b01d-73bc061881c1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:20.700777 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2a100f04-696b-45a6-b01d-73bc061881c1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:20.701273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2a100f04-696b-45a6-b01d-73bc061881c1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:20.701719 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2a100f04-696b-45a6-b01d-73bc061881c1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:20.702581 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2a100f04-696b-45a6-b01d-73bc061881c1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:20.702873 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2a100f04-696b-45a6-b01d-73bc061881c1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:20.703296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2a100f04-696b-45a6-b01d-73bc061881c1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:20.839235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2a100f04-696b-45a6-b01d-73bc061881c1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:20.847846 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2a100f04-696b-45a6-b01d-73bc061881c1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.160619 Aug 24 05:59:20.848440 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 623/1200] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:20 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:59:21.202407 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:21.203018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:21.209806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:21.210118 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:21.210556 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:21.211250 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:21.211709 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:21.212128 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:21.226314 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] HTTP exception thrown: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Request method failure captured: Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 HTTP/1.1 Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbsx39bq01s7lnlvC98awDgFA_LGJmOwy5svJIbrtZb9MVi4yhty5UzoKU07LeRfw66z8mqSjqRw0JpaYRExoBDMk4Wa3t7bqfnspm6TeXf8KtNGFHRff2nuK61ISJ4efQjlYQeUUZ4gmJ4nrYlg82GrXhTB3PpRNyxO9PRFqZOrQNs Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:59:21.227985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}] Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: c7ef3bf8dfd342f5a2fef02bf597af90 Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:21.229857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': 'a96fde59-06c5-4305-b87a-9fde71a07588'} Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:59:21.230893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:21.232550 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:21.233991 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Returning 404 to user: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:59:21.233991 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4efcced0-79db-47b1-892b-2b897be15a9c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 404 len: 111 microversion: 2.20 time: 0.030970 Aug 24 05:59:21.233991 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 578/1201] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:59:21 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:59:21.238893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a205506b-5d68-4d06-b3c2-ba7b97d5eba3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '.version_select at 0x7f065d691940>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:21.243418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a205506b-5d68-4d06-b3c2-ba7b97d5eba3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [1269fa74-5fdb-4cb5-84cd-baf5a8606b94] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:59:21.869432 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1cd2ceba-8e60-479f-9113-a7b97db05dbf tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:21.870039 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1cd2ceba-8e60-479f-9113-a7b97db05dbf tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:21.876582 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cd2ceba-8e60-479f-9113-a7b97db05dbf tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:21.877262 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cd2ceba-8e60-479f-9113-a7b97db05dbf tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:21.877712 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cd2ceba-8e60-479f-9113-a7b97db05dbf tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:21.878440 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cd2ceba-8e60-479f-9113-a7b97db05dbf tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:21.878909 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cd2ceba-8e60-479f-9113-a7b97db05dbf tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:21.879359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1cd2ceba-8e60-479f-9113-a7b97db05dbf tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:22.017113 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1cd2ceba-8e60-479f-9113-a7b97db05dbf tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:22.025418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1cd2ceba-8e60-479f-9113-a7b97db05dbf tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.159738 Aug 24 05:59:22.025992 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 579/1202] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:21 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:22.251001 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [None req-a205506b-5d68-4d06-b3c2-ba7b97d5eba3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [1269fa74-5fdb-4cb5-84cd-baf5a8606b94] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 53706. Aug 24 05:59:22.404569 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a205506b-5d68-4d06-b3c2-ba7b97d5eba3 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508786196" status: 204 len: 0 microversion: 2.20 time: 1.169966 Aug 24 05:59:22.405195 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 624/1203] 10.222.0.15 () {60 vars in 1259 bytes} [Wed Aug 24 05:59:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508786196 => generated 0 bytes in 1171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:59:23.047222 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9a941497-f31e-4fda-b2c1-3ea9d107cae8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:23.047856 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9a941497-f31e-4fda-b2c1-3ea9d107cae8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:23.056152 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a941497-f31e-4fda-b2c1-3ea9d107cae8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:23.056707 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a941497-f31e-4fda-b2c1-3ea9d107cae8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:23.057150 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a941497-f31e-4fda-b2c1-3ea9d107cae8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:23.057892 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a941497-f31e-4fda-b2c1-3ea9d107cae8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:23.058352 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a941497-f31e-4fda-b2c1-3ea9d107cae8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:23.065990 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9a941497-f31e-4fda-b2c1-3ea9d107cae8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:23.207584 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9a941497-f31e-4fda-b2c1-3ea9d107cae8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:23.215732 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9a941497-f31e-4fda-b2c1-3ea9d107cae8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.172559 Aug 24 05:59:23.217002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 580/1204] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:23 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:24.239999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b0a3fd8b-4dc6-442a-8b6f-043b7bc78ab2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:24.240661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b0a3fd8b-4dc6-442a-8b6f-043b7bc78ab2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:24.247756 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd8b-4dc6-442a-8b6f-043b7bc78ab2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:24.248254 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd8b-4dc6-442a-8b6f-043b7bc78ab2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:24.248726 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd8b-4dc6-442a-8b6f-043b7bc78ab2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:24.249433 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd8b-4dc6-442a-8b6f-043b7bc78ab2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:24.249892 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd8b-4dc6-442a-8b6f-043b7bc78ab2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:24.250321 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b0a3fd8b-4dc6-442a-8b6f-043b7bc78ab2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:24.389652 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b0a3fd8b-4dc6-442a-8b6f-043b7bc78ab2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:24.398414 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b0a3fd8b-4dc6-442a-8b6f-043b7bc78ab2 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.164328 Aug 24 05:59:24.398987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 625/1205] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:24 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:24.497876 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:24.498367 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:24.505498 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:24.505982 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:24.506419 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:24.507107 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:24.507559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:24.507978 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:24.522561 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] HTTP exception thrown: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Request method failure captured: Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: DELETE /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 HTTP/1.1 Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbsx39bq01s7lnlvC98awDgFA_LGJmOwy5svJIbrtZb9MVi4yhty5UzoKU07LeRfw66z8mqSjqRw0JpaYRExoBDMk4Wa3t7bqfnspm6TeXf8KtNGFHRff2nuK61ISJ4efQjlYQeUUZ4gmJ4nrYlg82GrXhTB3PpRNyxO9PRFqZOrQNs Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:59:24.524178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}] Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: c7ef3bf8dfd342f5a2fef02bf597af90 Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:24.526822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': 'a96fde59-06c5-4305-b87a-9fde71a07588'} Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:59:24.528496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:24.531559 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:24.534662 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Returning 404 to user: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:59:24.534662 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-327cb57d-da6a-4106-a5e8-422bfb431eb8 tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 404 len: 111 microversion: 2.20 time: 0.031716 Aug 24 05:59:24.534662 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 581/1206] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 24 05:59:24 2022] DELETE /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:59:24.536686 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:24.537303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: a96fde59-06c5-4305-b87a-9fde71a07588] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:24.543254 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:24.543739 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:24.544182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:24.544899 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:24.545385 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:24.545804 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:24.560791 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] HTTP exception thrown: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Request method failure captured: Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 HTTP/1.1 Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbsx39bq01s7lnlvC98awDgFA_LGJmOwy5svJIbrtZb9MVi4yhty5UzoKU07LeRfw66z8mqSjqRw0JpaYRExoBDMk4Wa3t7bqfnspm6TeXf8KtNGFHRff2nuK61ISJ4efQjlYQeUUZ4gmJ4nrYlg82GrXhTB3PpRNyxO9PRFqZOrQNs Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:59:24.562492 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}] Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: c7ef3bf8dfd342f5a2fef02bf597af90 Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:24.564561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': 'a96fde59-06c5-4305-b87a-9fde71a07588'} Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:59:24.565618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. Aug 24 05:59:24.567130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:59:24.568624 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Returning 404 to user: Instance a96fde59-06c5-4305-b87a-9fde71a07588 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:59:24.568624 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-33d82588-a345-4dbd-84ac-c348505ee27e tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588" status: 404 len: 111 microversion: 2.20 time: 0.032207 Aug 24 05:59:24.568624 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 626/1207] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:59:24 2022] GET /compute/v2.1/servers/a96fde59-06c5-4305-b87a-9fde71a07588 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:59:25.420174 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-20698259-a6e6-4cdf-b6da-c96207589703 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:25.420859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-20698259-a6e6-4cdf-b6da-c96207589703 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:25.428687 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-20698259-a6e6-4cdf-b6da-c96207589703 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:25.428919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-20698259-a6e6-4cdf-b6da-c96207589703 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:25.429373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-20698259-a6e6-4cdf-b6da-c96207589703 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:25.430071 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-20698259-a6e6-4cdf-b6da-c96207589703 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:25.430533 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-20698259-a6e6-4cdf-b6da-c96207589703 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:25.430963 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-20698259-a6e6-4cdf-b6da-c96207589703 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:25.449570 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=100 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:25.619834 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-20698259-a6e6-4cdf-b6da-c96207589703 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:25.630865 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-20698259-a6e6-4cdf-b6da-c96207589703 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.214782 Aug 24 05:59:25.634889 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 582/1208] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:25 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:25.833902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:25.834455 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:25.841499 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:25.841985 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:25.842550 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:25.843339 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:25.843803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:25.844361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:25.860130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] HTTP exception thrown: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Request method failure captured: Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: DELETE /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 HTTP/1.1 Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbsx39bq01s7lnlvC98awDgFA_LGJmOwy5svJIbrtZb9MVi4yhty5UzoKU07LeRfw66z8mqSjqRw0JpaYRExoBDMk4Wa3t7bqfnspm6TeXf8KtNGFHRff2nuK61ISJ4efQjlYQeUUZ4gmJ4nrYlg82GrXhTB3PpRNyxO9PRFqZOrQNs Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 05:59:25.862506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}] Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: c7ef3bf8dfd342f5a2fef02bf597af90 Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:59:25.864327 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '27d92fba-9c39-4b5f-971f-83d972055316'} Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:59:25.865220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:59:25.866552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 05:59:25.867917 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Returning 404 to user: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:59:25.867917 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8d5d5267-3749-4c8d-a9dc-d5e6b7e1da6c tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 404 len: 111 microversion: 2.20 time: 0.034825 Aug 24 05:59:25.867917 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 627/1209] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 24 05:59:25 2022] DELETE /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:59:25.872634 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:25.873252 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] [instance: 27d92fba-9c39-4b5f-971f-83d972055316] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:25.880754 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:25.881323 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:25.881768 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:25.882630 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:25.883107 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:25.883547 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:25.898502 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] HTTP exception thrown: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Request method failure captured: Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 HTTP/1.1 Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbsx39bq01s7lnlvC98awDgFA_LGJmOwy5svJIbrtZb9MVi4yhty5UzoKU07LeRfw66z8mqSjqRw0JpaYRExoBDMk4Wa3t7bqfnspm6TeXf8KtNGFHRff2nuK61ISJ4efQjlYQeUUZ4gmJ4nrYlg82GrXhTB3PpRNyxO9PRFqZOrQNs Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 05:59:25.900083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56fbd96812654d16bbcf3522574a67eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56fbd96812654d16bbcf3522574a67eb"}]}] Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 56fbd96812654d16bbcf3522574a67eb Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-923908199 Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: c7ef3bf8dfd342f5a2fef02bf597af90 Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeShelveTestJSON-923908199-project Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:59:25.901859 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '27d92fba-9c39-4b5f-971f-83d972055316'} Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:59:25.902724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. Aug 24 05:59:25.904023 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 05:59:25.905216 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] Returning 404 to user: Instance 27d92fba-9c39-4b5f-971f-83d972055316 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:59:25.905216 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-27596716-2a2d-4e21-9905-67a2578618ba tempest-AttachVolumeShelveTestJSON-923908199 tempest-AttachVolumeShelveTestJSON-923908199-project] 10.222.0.15 "GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316" status: 404 len: 111 microversion: 2.20 time: 0.032894 Aug 24 05:59:25.905216 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 583/1210] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 24 05:59:25 2022] GET /compute/v2.1/servers/27d92fba-9c39-4b5f-971f-83d972055316 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 05:59:26.656834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-55d9b01c-c072-4639-9362-045ff95db206 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:26.658608 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-55d9b01c-c072-4639-9362-045ff95db206 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:26.667719 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d9b01c-c072-4639-9362-045ff95db206 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:26.668449 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d9b01c-c072-4639-9362-045ff95db206 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:26.669162 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d9b01c-c072-4639-9362-045ff95db206 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:26.670250 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d9b01c-c072-4639-9362-045ff95db206 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:26.670903 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d9b01c-c072-4639-9362-045ff95db206 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:26.671539 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-55d9b01c-c072-4639-9362-045ff95db206 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:26.881181 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-55d9b01c-c072-4639-9362-045ff95db206 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:26.889226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-55d9b01c-c072-4639-9362-045ff95db206 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.240510 Aug 24 05:59:26.889797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 628/1211] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:26 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:27.911468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-95f08f07-fda9-4aa3-a5ee-257ab1f770ed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:27.912580 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-95f08f07-fda9-4aa3-a5ee-257ab1f770ed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:27.919937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95f08f07-fda9-4aa3-a5ee-257ab1f770ed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:27.920847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95f08f07-fda9-4aa3-a5ee-257ab1f770ed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:27.921679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95f08f07-fda9-4aa3-a5ee-257ab1f770ed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:27.922809 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95f08f07-fda9-4aa3-a5ee-257ab1f770ed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:27.924457 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95f08f07-fda9-4aa3-a5ee-257ab1f770ed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:27.924975 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-95f08f07-fda9-4aa3-a5ee-257ab1f770ed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:28.089499 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-95f08f07-fda9-4aa3-a5ee-257ab1f770ed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:28.097822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-95f08f07-fda9-4aa3-a5ee-257ab1f770ed tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.191223 Aug 24 05:59:28.098410 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 584/1212] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:27 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:29.121292 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9e039c70-8700-4a61-be77-82254ca696ba tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:29.122180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9e039c70-8700-4a61-be77-82254ca696ba tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:29.126582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:29.131647 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e039c70-8700-4a61-be77-82254ca696ba tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:29.132499 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e039c70-8700-4a61-be77-82254ca696ba tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:29.133110 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e039c70-8700-4a61-be77-82254ca696ba tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:29.139222 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e039c70-8700-4a61-be77-82254ca696ba tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:29.139222 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e039c70-8700-4a61-be77-82254ca696ba tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:29.139222 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9e039c70-8700-4a61-be77-82254ca696ba tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:29.325427 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9e039c70-8700-4a61-be77-82254ca696ba tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:29.330620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9e039c70-8700-4a61-be77-82254ca696ba tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.213358 Aug 24 05:59:29.331215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 629/1213] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:29 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:30.352047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2b8f6acc-f136-4c38-bf6a-ac961c559b24 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:30.352724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2b8f6acc-f136-4c38-bf6a-ac961c559b24 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:30.355144 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=52 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:30.359984 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b8f6acc-f136-4c38-bf6a-ac961c559b24 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:30.362296 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b8f6acc-f136-4c38-bf6a-ac961c559b24 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:30.362296 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b8f6acc-f136-4c38-bf6a-ac961c559b24 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:30.362296 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b8f6acc-f136-4c38-bf6a-ac961c559b24 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:30.362607 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b8f6acc-f136-4c38-bf6a-ac961c559b24 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:30.362768 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2b8f6acc-f136-4c38-bf6a-ac961c559b24 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:30.496914 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2b8f6acc-f136-4c38-bf6a-ac961c559b24 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:30.509844 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2b8f6acc-f136-4c38-bf6a-ac961c559b24 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.161798 Aug 24 05:59:30.510419 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 585/1214] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:30 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:31.531543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b13cd932-ec29-42e4-ae8e-66ab57fe97c0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:31.532752 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b13cd932-ec29-42e4-ae8e-66ab57fe97c0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:31.540141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b13cd932-ec29-42e4-ae8e-66ab57fe97c0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:31.541070 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b13cd932-ec29-42e4-ae8e-66ab57fe97c0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:31.541214 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b13cd932-ec29-42e4-ae8e-66ab57fe97c0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:31.541854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b13cd932-ec29-42e4-ae8e-66ab57fe97c0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:31.542304 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b13cd932-ec29-42e4-ae8e-66ab57fe97c0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:31.542725 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b13cd932-ec29-42e4-ae8e-66ab57fe97c0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:31.717289 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b13cd932-ec29-42e4-ae8e-66ab57fe97c0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:31.725816 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b13cd932-ec29-42e4-ae8e-66ab57fe97c0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.198595 Aug 24 05:59:31.726381 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 630/1215] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:31 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:32.747327 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-822fe94d-366f-46b2-8f39-7067ddf8faf0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:32.747886 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-822fe94d-366f-46b2-8f39-7067ddf8faf0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:32.755469 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-822fe94d-366f-46b2-8f39-7067ddf8faf0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:32.756036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-822fe94d-366f-46b2-8f39-7067ddf8faf0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:32.756546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-822fe94d-366f-46b2-8f39-7067ddf8faf0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:32.757264 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-822fe94d-366f-46b2-8f39-7067ddf8faf0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:32.757727 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-822fe94d-366f-46b2-8f39-7067ddf8faf0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:32.758158 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-822fe94d-366f-46b2-8f39-7067ddf8faf0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:32.895349 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-822fe94d-366f-46b2-8f39-7067ddf8faf0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:32.903532 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-822fe94d-366f-46b2-8f39-7067ddf8faf0 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.160378 Aug 24 05:59:32.904163 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 586/1216] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:32 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:33.928664 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-780d2434-b747-45bb-bb30-85db909804ec tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:33.929088 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-780d2434-b747-45bb-bb30-85db909804ec tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:33.935820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-780d2434-b747-45bb-bb30-85db909804ec tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:33.936331 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-780d2434-b747-45bb-bb30-85db909804ec tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:33.936832 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-780d2434-b747-45bb-bb30-85db909804ec tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:33.937593 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-780d2434-b747-45bb-bb30-85db909804ec tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:33.938081 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-780d2434-b747-45bb-bb30-85db909804ec tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:33.939225 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-780d2434-b747-45bb-bb30-85db909804ec tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:34.108657 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-780d2434-b747-45bb-bb30-85db909804ec tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:34.117330 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-780d2434-b747-45bb-bb30-85db909804ec tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.193285 Aug 24 05:59:34.118029 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 631/1217] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:33 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:35.139203 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1f5180e1-f9c6-4c5d-9fc5-69c87b3c4321 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:35.139847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1f5180e1-f9c6-4c5d-9fc5-69c87b3c4321 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:35.146580 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f5180e1-f9c6-4c5d-9fc5-69c87b3c4321 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:35.147066 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f5180e1-f9c6-4c5d-9fc5-69c87b3c4321 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:35.147504 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f5180e1-f9c6-4c5d-9fc5-69c87b3c4321 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:35.148201 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f5180e1-f9c6-4c5d-9fc5-69c87b3c4321 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:35.148679 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f5180e1-f9c6-4c5d-9fc5-69c87b3c4321 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:35.149225 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1f5180e1-f9c6-4c5d-9fc5-69c87b3c4321 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:35.286083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1f5180e1-f9c6-4c5d-9fc5-69c87b3c4321 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:35.293908 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1f5180e1-f9c6-4c5d-9fc5-69c87b3c4321 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.158604 Aug 24 05:59:35.294464 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 587/1218] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:35 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:36.316524 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0ebe7f90-093a-4600-9b83-4f9b8a1d6916 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:36.317140 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0ebe7f90-093a-4600-9b83-4f9b8a1d6916 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:36.323945 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ebe7f90-093a-4600-9b83-4f9b8a1d6916 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:36.324140 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ebe7f90-093a-4600-9b83-4f9b8a1d6916 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:36.324600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ebe7f90-093a-4600-9b83-4f9b8a1d6916 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:36.325303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ebe7f90-093a-4600-9b83-4f9b8a1d6916 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:36.325764 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ebe7f90-093a-4600-9b83-4f9b8a1d6916 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:36.326190 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ebe7f90-093a-4600-9b83-4f9b8a1d6916 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:36.471873 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0ebe7f90-093a-4600-9b83-4f9b8a1d6916 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:36.480696 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0ebe7f90-093a-4600-9b83-4f9b8a1d6916 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.168935 Aug 24 05:59:36.481388 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 632/1219] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:36 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:37.504261 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e5942823-2a10-4c15-a6a7-f6ea7bed2fee tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:37.505036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e5942823-2a10-4c15-a6a7-f6ea7bed2fee tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:37.511570 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5942823-2a10-4c15-a6a7-f6ea7bed2fee tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:37.512064 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5942823-2a10-4c15-a6a7-f6ea7bed2fee tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:37.512536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5942823-2a10-4c15-a6a7-f6ea7bed2fee tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:37.513246 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5942823-2a10-4c15-a6a7-f6ea7bed2fee tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:37.513707 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5942823-2a10-4c15-a6a7-f6ea7bed2fee tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:37.514140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e5942823-2a10-4c15-a6a7-f6ea7bed2fee tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:37.655257 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e5942823-2a10-4c15-a6a7-f6ea7bed2fee tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:37.665458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e5942823-2a10-4c15-a6a7-f6ea7bed2fee tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.165941 Aug 24 05:59:37.670778 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 588/1220] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:37 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:38.686915 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a7924145-8696-4761-980c-f5b04b67fe6c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:38.687618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a7924145-8696-4761-980c-f5b04b67fe6c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:38.694266 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7924145-8696-4761-980c-f5b04b67fe6c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:38.694681 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7924145-8696-4761-980c-f5b04b67fe6c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:38.695111 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7924145-8696-4761-980c-f5b04b67fe6c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:38.695797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7924145-8696-4761-980c-f5b04b67fe6c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:38.696244 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7924145-8696-4761-980c-f5b04b67fe6c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:38.696687 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7924145-8696-4761-980c-f5b04b67fe6c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:38.831994 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a7924145-8696-4761-980c-f5b04b67fe6c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:38.840098 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a7924145-8696-4761-980c-f5b04b67fe6c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.156954 Aug 24 05:59:38.840685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 633/1221] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:38 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:39.862398 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c88128f8-c08a-4b59-af1f-4cf6cc8d3253 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:39.863224 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c88128f8-c08a-4b59-af1f-4cf6cc8d3253 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:39.871268 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c88128f8-c08a-4b59-af1f-4cf6cc8d3253 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:39.871758 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c88128f8-c08a-4b59-af1f-4cf6cc8d3253 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:39.872197 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c88128f8-c08a-4b59-af1f-4cf6cc8d3253 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:39.872921 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c88128f8-c08a-4b59-af1f-4cf6cc8d3253 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:39.873385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c88128f8-c08a-4b59-af1f-4cf6cc8d3253 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:39.873808 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c88128f8-c08a-4b59-af1f-4cf6cc8d3253 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:40.011569 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c88128f8-c08a-4b59-af1f-4cf6cc8d3253 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:40.019473 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c88128f8-c08a-4b59-af1f-4cf6cc8d3253 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.161606 Aug 24 05:59:40.020041 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 589/1222] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:39 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:41.041112 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ca51a1d4-65d5-4ad8-8dde-5f6a89a27aae tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:41.041723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ca51a1d4-65d5-4ad8-8dde-5f6a89a27aae tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:41.048924 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ca51a1d4-65d5-4ad8-8dde-5f6a89a27aae tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:41.049418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ca51a1d4-65d5-4ad8-8dde-5f6a89a27aae tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:41.049890 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ca51a1d4-65d5-4ad8-8dde-5f6a89a27aae tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:41.050591 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ca51a1d4-65d5-4ad8-8dde-5f6a89a27aae tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:41.051313 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ca51a1d4-65d5-4ad8-8dde-5f6a89a27aae tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:41.051744 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ca51a1d4-65d5-4ad8-8dde-5f6a89a27aae tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:41.194252 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ca51a1d4-65d5-4ad8-8dde-5f6a89a27aae tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:41.202490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ca51a1d4-65d5-4ad8-8dde-5f6a89a27aae tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.165207 Aug 24 05:59:41.203239 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 634/1223] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:41 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:42.224411 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-2315f8f5-ab0b-4544-a0c3-b4b8ee091824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:42.225056 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-2315f8f5-ab0b-4544-a0c3-b4b8ee091824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:42.232532 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2315f8f5-ab0b-4544-a0c3-b4b8ee091824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:42.233017 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2315f8f5-ab0b-4544-a0c3-b4b8ee091824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:42.233452 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2315f8f5-ab0b-4544-a0c3-b4b8ee091824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:42.234314 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2315f8f5-ab0b-4544-a0c3-b4b8ee091824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:42.235606 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2315f8f5-ab0b-4544-a0c3-b4b8ee091824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:42.236130 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-2315f8f5-ab0b-4544-a0c3-b4b8ee091824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:42.375360 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-2315f8f5-ab0b-4544-a0c3-b4b8ee091824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:42.382983 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-2315f8f5-ab0b-4544-a0c3-b4b8ee091824 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1678 microversion: 2.1 time: 0.162511 Aug 24 05:59:42.383636 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 590/1224] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:42 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:43.404626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-80c109ad-c929-419a-a4b4-3f1272832a11 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:43.405292 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-80c109ad-c929-419a-a4b4-3f1272832a11 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:43.413384 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-80c109ad-c929-419a-a4b4-3f1272832a11 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:43.421508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-80c109ad-c929-419a-a4b4-3f1272832a11 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:43.421508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-80c109ad-c929-419a-a4b4-3f1272832a11 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:43.421508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-80c109ad-c929-419a-a4b4-3f1272832a11 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:43.421508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-80c109ad-c929-419a-a4b4-3f1272832a11 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:43.421956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-80c109ad-c929-419a-a4b4-3f1272832a11 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:43.552447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-80c109ad-c929-419a-a4b4-3f1272832a11 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:43.560305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-80c109ad-c929-419a-a4b4-3f1272832a11 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1655 microversion: 2.1 time: 0.159584 Aug 24 05:59:43.560995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 635/1225] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:43 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:43.583794 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e07accb3-c468-4f0d-9791-cc2415f5422d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:59:43.588381 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e07accb3-c468-4f0d-9791-cc2415f5422d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:43.588900 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e07accb3-c468-4f0d-9791-cc2415f5422d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:43.589371 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e07accb3-c468-4f0d-9791-cc2415f5422d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:43.650995 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e07accb3-c468-4f0d-9791-cc2415f5422d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Going to try to start instance {{(pid=127755) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 05:59:43.870169 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e07accb3-c468-4f0d-9791-cc2415f5422d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "POST /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/action" status: 202 len: 0 microversion: 2.1 time: 0.292401 Aug 24 05:59:43.870714 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 591/1226] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 05:59:43 2022] POST /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:59:43.879710 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c6aabc2a-e9c3-4b74-8d6b-431cd05130e4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:43.880439 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c6aabc2a-e9c3-4b74-8d6b-431cd05130e4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:43.886377 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6aabc2a-e9c3-4b74-8d6b-431cd05130e4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:43.886858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6aabc2a-e9c3-4b74-8d6b-431cd05130e4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:43.887291 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6aabc2a-e9c3-4b74-8d6b-431cd05130e4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:43.888003 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6aabc2a-e9c3-4b74-8d6b-431cd05130e4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:43.888480 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6aabc2a-e9c3-4b74-8d6b-431cd05130e4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:43.888905 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c6aabc2a-e9c3-4b74-8d6b-431cd05130e4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:44.031241 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c6aabc2a-e9c3-4b74-8d6b-431cd05130e4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:44.044619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c6aabc2a-e9c3-4b74-8d6b-431cd05130e4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1664 microversion: 2.1 time: 0.164633 Aug 24 05:59:44.044619 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 636/1227] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:43 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:44.060650 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8e0ee99d-dc63-4619-b3bb-3a68c2fb0156 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "782d3752-28c6-4fa5-b48b-525574be74e8", "device": "/dev/sdb"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:59:44.065348 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8e0ee99d-dc63-4619-b3bb-3a68c2fb0156 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:44.072248 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e0ee99d-dc63-4619-b3bb-3a68c2fb0156 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:44.072776 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e0ee99d-dc63-4619-b3bb-3a68c2fb0156 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:44.073224 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e0ee99d-dc63-4619-b3bb-3a68c2fb0156 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:44.073928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e0ee99d-dc63-4619-b3bb-3a68c2fb0156 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:44.074530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e0ee99d-dc63-4619-b3bb-3a68c2fb0156 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:44.075264 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e0ee99d-dc63-4619-b3bb-3a68c2fb0156 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:44.378568 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:59:44.378933 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Wed Aug 24 05:59:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939/os-volume_attachments (ip 10.222.0.15) !!! Aug 24 05:59:45.025729 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8e0ee99d-dc63-4619-b3bb-3a68c2fb0156 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "POST /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.969247 Aug 24 05:59:45.026432 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 592/1228] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 05:59:44 2022] POST /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939/os-volume_attachments => generated 194 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:59:45.064987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7a6cb7c5-a815-4e8a-ab8c-13f1a82a4e22 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:45.065600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7a6cb7c5-a815-4e8a-ab8c-13f1a82a4e22 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:45.071961 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7a6cb7c5-a815-4e8a-ab8c-13f1a82a4e22 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:45.072688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7a6cb7c5-a815-4e8a-ab8c-13f1a82a4e22 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:45.073314 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7a6cb7c5-a815-4e8a-ab8c-13f1a82a4e22 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:45.074023 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7a6cb7c5-a815-4e8a-ab8c-13f1a82a4e22 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:45.074521 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7a6cb7c5-a815-4e8a-ab8c-13f1a82a4e22 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:45.074947 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7a6cb7c5-a815-4e8a-ab8c-13f1a82a4e22 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:45.222077 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7a6cb7c5-a815-4e8a-ab8c-13f1a82a4e22 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:45.229950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7a6cb7c5-a815-4e8a-ab8c-13f1a82a4e22 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1664 microversion: 2.1 time: 0.170106 Aug 24 05:59:45.230533 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 637/1229] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:45 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:46.252289 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-78671aac-9f3d-4ce7-ac04-bd76c36468b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:46.252952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-78671aac-9f3d-4ce7-ac04-bd76c36468b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:46.259673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78671aac-9f3d-4ce7-ac04-bd76c36468b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:46.260284 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78671aac-9f3d-4ce7-ac04-bd76c36468b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:46.260761 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78671aac-9f3d-4ce7-ac04-bd76c36468b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:46.261464 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78671aac-9f3d-4ce7-ac04-bd76c36468b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:46.261928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78671aac-9f3d-4ce7-ac04-bd76c36468b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:46.262367 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-78671aac-9f3d-4ce7-ac04-bd76c36468b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:46.397824 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-78671aac-9f3d-4ce7-ac04-bd76c36468b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:46.405833 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-78671aac-9f3d-4ce7-ac04-bd76c36468b1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1664 microversion: 2.1 time: 0.158395 Aug 24 05:59:46.411260 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 593/1230] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:46 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:47.428391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a9ba8a36-4c51-4ff9-857d-5601f658b79f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:47.428391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a9ba8a36-4c51-4ff9-857d-5601f658b79f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:47.435179 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9ba8a36-4c51-4ff9-857d-5601f658b79f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:47.435673 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9ba8a36-4c51-4ff9-857d-5601f658b79f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:47.436114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9ba8a36-4c51-4ff9-857d-5601f658b79f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:47.436846 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9ba8a36-4c51-4ff9-857d-5601f658b79f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:47.437314 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9ba8a36-4c51-4ff9-857d-5601f658b79f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:47.437736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9ba8a36-4c51-4ff9-857d-5601f658b79f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:47.582720 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a9ba8a36-4c51-4ff9-857d-5601f658b79f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:47.590686 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a9ba8a36-4c51-4ff9-857d-5601f658b79f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1668 microversion: 2.1 time: 0.166527 Aug 24 05:59:47.591176 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 638/1231] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:47 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:00:00.043958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-41d02422-da85-490a-8f63-fff3d66bed4a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:00.044539 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-41d02422-da85-490a-8f63-fff3d66bed4a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:00.047295 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=17 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:00.048180 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:00.056044 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41d02422-da85-490a-8f63-fff3d66bed4a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:00.056578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41d02422-da85-490a-8f63-fff3d66bed4a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:00.057048 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41d02422-da85-490a-8f63-fff3d66bed4a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:00.057699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=19 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:00.058175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41d02422-da85-490a-8f63-fff3d66bed4a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:00.062821 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41d02422-da85-490a-8f63-fff3d66bed4a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:00.062821 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-41d02422-da85-490a-8f63-fff3d66bed4a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:00.063059 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=88 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:00.088226 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-41d02422-da85-490a-8f63-fff3d66bed4a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:00:00.196845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-6fd1bdda-466d-4513-82bf-396a40339e12 req-25135de2-0afd-4900-8d2e-b4532fb9d846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930020e6-49a9-488f-870a-1da855b88720", "tag": "05efbf18-2e2f-490b-b7d8-fda19d6de7d8"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:00:00.207474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-6fd1bdda-466d-4513-82bf-396a40339e12 req-25135de2-0afd-4900-8d2e-b4532fb9d846 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:00.208051 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-6fd1bdda-466d-4513-82bf-396a40339e12 req-25135de2-0afd-4900-8d2e-b4532fb9d846 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:00.208626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-6fd1bdda-466d-4513-82bf-396a40339e12 req-25135de2-0afd-4900-8d2e-b4532fb9d846 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:00.222644 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-6fd1bdda-466d-4513-82bf-396a40339e12 req-25135de2-0afd-4900-8d2e-b4532fb9d846 service nova] Creating event network-changed:05efbf18-2e2f-490b-b7d8-fda19d6de7d8 for instance 930020e6-49a9-488f-870a-1da855b88720 on hv-cinder-85426 Aug 24 06:00:00.229519 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-6fd1bdda-466d-4513-82bf-396a40339e12 req-25135de2-0afd-4900-8d2e-b4532fb9d846 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186502 Aug 24 06:00:00.229519 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 639/1232] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:00:00.511536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-41d02422-da85-490a-8f63-fff3d66bed4a tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "DELETE /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 204 len: 0 microversion: 2.1 time: 0.471739 Aug 24 06:00:00.512058 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 594/1233] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 06:00:00 2022] DELETE /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:00:00.524010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-285dbe0f-b7ea-4bbc-9efd-0b944654dfa9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:00.524700 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-285dbe0f-b7ea-4bbc-9efd-0b944654dfa9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:00.532056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-285dbe0f-b7ea-4bbc-9efd-0b944654dfa9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:00.532597 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-285dbe0f-b7ea-4bbc-9efd-0b944654dfa9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:00.533030 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-285dbe0f-b7ea-4bbc-9efd-0b944654dfa9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:00.533724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-285dbe0f-b7ea-4bbc-9efd-0b944654dfa9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:00.534170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-285dbe0f-b7ea-4bbc-9efd-0b944654dfa9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:00.534588 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-285dbe0f-b7ea-4bbc-9efd-0b944654dfa9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:00.736011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-285dbe0f-b7ea-4bbc-9efd-0b944654dfa9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:00.746895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-285dbe0f-b7ea-4bbc-9efd-0b944654dfa9 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1576 microversion: 2.1 time: 0.229226 Aug 24 06:00:00.748250 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 640/1234] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:00 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:00:01.769303 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-83588bf4-03db-4dcb-9a19-9053202a7ba0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:01.770045 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-83588bf4-03db-4dcb-9a19-9053202a7ba0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:01.777118 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83588bf4-03db-4dcb-9a19-9053202a7ba0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:01.777606 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83588bf4-03db-4dcb-9a19-9053202a7ba0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:01.778050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83588bf4-03db-4dcb-9a19-9053202a7ba0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:01.778744 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83588bf4-03db-4dcb-9a19-9053202a7ba0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:01.779204 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83588bf4-03db-4dcb-9a19-9053202a7ba0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:01.779631 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-83588bf4-03db-4dcb-9a19-9053202a7ba0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:01.950175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-83588bf4-03db-4dcb-9a19-9053202a7ba0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:01.954981 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-83588bf4-03db-4dcb-9a19-9053202a7ba0 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1576 microversion: 2.1 time: 0.190297 Aug 24 06:00:01.955959 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 595/1235] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:01 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:02.977259 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0a53f88c-d209-4f9d-ae5f-1617bb08293c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:02.977904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0a53f88c-d209-4f9d-ae5f-1617bb08293c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:02.985625 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a53f88c-d209-4f9d-ae5f-1617bb08293c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:02.986044 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a53f88c-d209-4f9d-ae5f-1617bb08293c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:02.986490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a53f88c-d209-4f9d-ae5f-1617bb08293c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:02.987189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a53f88c-d209-4f9d-ae5f-1617bb08293c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:02.987639 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a53f88c-d209-4f9d-ae5f-1617bb08293c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:02.988061 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0a53f88c-d209-4f9d-ae5f-1617bb08293c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:03.131973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0a53f88c-d209-4f9d-ae5f-1617bb08293c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:03.139714 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0a53f88c-d209-4f9d-ae5f-1617bb08293c tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1458 microversion: 2.1 time: 0.166464 Aug 24 06:00:03.144990 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 641/1236] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:02 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1458 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:04.160307 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-74a7b372-99cb-4e17-bbc0-582f7e6dc703 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:04.161177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-74a7b372-99cb-4e17-bbc0-582f7e6dc703 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:04.167360 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74a7b372-99cb-4e17-bbc0-582f7e6dc703 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:04.167842 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74a7b372-99cb-4e17-bbc0-582f7e6dc703 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:04.168277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74a7b372-99cb-4e17-bbc0-582f7e6dc703 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:04.169135 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74a7b372-99cb-4e17-bbc0-582f7e6dc703 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:04.169595 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74a7b372-99cb-4e17-bbc0-582f7e6dc703 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:04.170019 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-74a7b372-99cb-4e17-bbc0-582f7e6dc703 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:04.299648 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-74a7b372-99cb-4e17-bbc0-582f7e6dc703 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:04.307603 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-74a7b372-99cb-4e17-bbc0-582f7e6dc703 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1458 microversion: 2.1 time: 0.151217 Aug 24 06:00:04.308167 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 596/1237] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:04 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1458 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:05.330107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ee5a1456-1a98-42f9-9575-6f6cadb554ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:05.330633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ee5a1456-1a98-42f9-9575-6f6cadb554ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:05.337082 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ee5a1456-1a98-42f9-9575-6f6cadb554ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:05.337556 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ee5a1456-1a98-42f9-9575-6f6cadb554ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:05.337987 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ee5a1456-1a98-42f9-9575-6f6cadb554ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:05.338665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ee5a1456-1a98-42f9-9575-6f6cadb554ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:05.339113 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ee5a1456-1a98-42f9-9575-6f6cadb554ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:05.339549 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ee5a1456-1a98-42f9-9575-6f6cadb554ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:05.475643 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ee5a1456-1a98-42f9-9575-6f6cadb554ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:05.483371 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ee5a1456-1a98-42f9-9575-6f6cadb554ad tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1458 microversion: 2.1 time: 0.157899 Aug 24 06:00:05.483950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 642/1238] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:05 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1458 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:06.505417 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c1987d34-21b4-4f53-8d69-22914abf2faf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:06.506030 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c1987d34-21b4-4f53-8d69-22914abf2faf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:06.512514 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c1987d34-21b4-4f53-8d69-22914abf2faf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:06.513004 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c1987d34-21b4-4f53-8d69-22914abf2faf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:06.513447 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c1987d34-21b4-4f53-8d69-22914abf2faf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:06.514143 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c1987d34-21b4-4f53-8d69-22914abf2faf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:06.514604 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c1987d34-21b4-4f53-8d69-22914abf2faf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:06.515040 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c1987d34-21b4-4f53-8d69-22914abf2faf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:06.648782 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c1987d34-21b4-4f53-8d69-22914abf2faf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:06.657114 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c1987d34-21b4-4f53-8d69-22914abf2faf tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1458 microversion: 2.1 time: 0.155629 Aug 24 06:00:06.659780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 597/1239] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:06 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:07.678889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8ecb77f2-c566-4b02-a3b8-43374bee5f51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:07.679488 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8ecb77f2-c566-4b02-a3b8-43374bee5f51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:07.685934 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8ecb77f2-c566-4b02-a3b8-43374bee5f51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:07.686412 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8ecb77f2-c566-4b02-a3b8-43374bee5f51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:07.686855 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8ecb77f2-c566-4b02-a3b8-43374bee5f51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:07.688161 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8ecb77f2-c566-4b02-a3b8-43374bee5f51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:07.688664 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8ecb77f2-c566-4b02-a3b8-43374bee5f51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:07.689091 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8ecb77f2-c566-4b02-a3b8-43374bee5f51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:07.827457 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8ecb77f2-c566-4b02-a3b8-43374bee5f51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:07.836106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8ecb77f2-c566-4b02-a3b8-43374bee5f51 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1458 microversion: 2.1 time: 0.161303 Aug 24 06:00:07.836757 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 643/1240] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:07 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:08.307874 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-b82c5e4d-1c88-4626-8e99-c5f9ce3b31fb req-d076a702-6a88-4d64-b47d-53502d9688ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930020e6-49a9-488f-870a-1da855b88720", "name": "network-vif-deleted", "tag": "05efbf18-2e2f-490b-b7d8-fda19d6de7d8"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:00:08.319002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-b82c5e4d-1c88-4626-8e99-c5f9ce3b31fb req-d076a702-6a88-4d64-b47d-53502d9688ba service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:08.319520 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-b82c5e4d-1c88-4626-8e99-c5f9ce3b31fb req-d076a702-6a88-4d64-b47d-53502d9688ba service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:08.319958 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-b82c5e4d-1c88-4626-8e99-c5f9ce3b31fb req-d076a702-6a88-4d64-b47d-53502d9688ba service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:08.332294 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-b82c5e4d-1c88-4626-8e99-c5f9ce3b31fb req-d076a702-6a88-4d64-b47d-53502d9688ba service nova] Creating event network-vif-deleted:05efbf18-2e2f-490b-b7d8-fda19d6de7d8 for instance 930020e6-49a9-488f-870a-1da855b88720 on hv-cinder-85426 Aug 24 06:00:08.342798 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-b82c5e4d-1c88-4626-8e99-c5f9ce3b31fb req-d076a702-6a88-4d64-b47d-53502d9688ba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038571 Aug 24 06:00:08.343599 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 598/1241] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:00:08.857805 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-91f22724-c7a0-417f-b7d6-5e4efadfdf55 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:08.858377 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-91f22724-c7a0-417f-b7d6-5e4efadfdf55 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:08.865901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f22724-c7a0-417f-b7d6-5e4efadfdf55 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:08.866379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f22724-c7a0-417f-b7d6-5e4efadfdf55 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:08.866808 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f22724-c7a0-417f-b7d6-5e4efadfdf55 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:08.867497 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f22724-c7a0-417f-b7d6-5e4efadfdf55 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:08.867946 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f22724-c7a0-417f-b7d6-5e4efadfdf55 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:08.868536 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-91f22724-c7a0-417f-b7d6-5e4efadfdf55 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:08.932561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-91f22724-c7a0-417f-b7d6-5e4efadfdf55 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:08.941181 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-91f22724-c7a0-417f-b7d6-5e4efadfdf55 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1226 microversion: 2.1 time: 0.087433 Aug 24 06:00:08.941784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 644/1242] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:08 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:09.964083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:09.965064 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:09.971544 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:09.971924 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:09.972373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:09.973100 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:09.973562 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:09.973994 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:10.019301 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:10.019301 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:10.019301 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:10.019301 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lazy-loading 'fault' on Instance uuid 930020e6-49a9-488f-870a-1da855b88720 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:00:10.055910 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:10.064535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-50761567-c1bc-4b01-854c-91b5478f4f71 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1231 microversion: 2.1 time: 0.105648 Aug 24 06:00:10.068176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 599/1243] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:09 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:11.085990 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:11.086738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:11.094014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:11.094488 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:11.094919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:11.095601 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:11.096073 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:11.096537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:11.128413 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:11.128903 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:11.129342 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:11.129781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lazy-loading 'fault' on Instance uuid 930020e6-49a9-488f-870a-1da855b88720 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:00:11.172820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:11.181098 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8de1d385-a1e4-46f8-98c0-d371440145fd tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 200 len: 1231 microversion: 2.1 time: 0.098844 Aug 24 06:00:11.181684 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 645/1244] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:11 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:12.202794 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:12.203443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 930020e6-49a9-488f-870a-1da855b88720] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:12.209904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:12.210382 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:12.210819 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:12.211502 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:12.211952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:12.212373 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:12.226208 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] HTTP exception thrown: Instance 930020e6-49a9-488f-870a-1da855b88720 could not be found. Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Request method failure captured: Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 HTTP/1.1 Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbu8dOm3pONZeIx1jm41sC2N19NTM9c2O2gbdu8wWljUb9dfKKLzEQgV6V8eIxiMDIZk8bRAVSGnIv1ojnl-i-wfrjAmSAD5bWbO5xE_bUuADpUEWkm8NZ1lfDs_2A_KrShF9bSCJ5ctj6no6GXNNDfWa2p9q_kagE6Yuy0KpiOIjs0 Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 8e8dbc250d3447ecbd8c7b6df2d10d2c Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 06:00:12.227866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}] Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 8e8dbc250d3447ecbd8c7b6df2d10d2c Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-TestVolumeBootPattern-1103499817-project Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: b92925514b544fbe9e34326f9c48cb24 Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-TestVolumeBootPattern-1103499817-project Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 930020e6-49a9-488f-870a-1da855b88720 could not be found. Aug 24 06:00:12.229664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '930020e6-49a9-488f-870a-1da855b88720'} Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 930020e6-49a9-488f-870a-1da855b88720 could not be found. Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:00:12.230700 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 930020e6-49a9-488f-870a-1da855b88720 could not be found. Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 930020e6-49a9-488f-870a-1da855b88720 could not be found. Aug 24 06:00:12.232660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:00:12.234876 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Returning 404 to user: Instance 930020e6-49a9-488f-870a-1da855b88720 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:00:12.234876 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8103236e-e662-4e20-9d6e-2e3f68ef68b1 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720" status: 404 len: 111 microversion: 2.1 time: 0.030651 Aug 24 06:00:12.234876 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 600/1245] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:12 2022] GET /compute/v2.1/servers/930020e6-49a9-488f-870a-1da855b88720 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:00:18.796170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-be05c0c7-2a25-43d9-b528-d17834172010 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:18.796846 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-be05c0c7-2a25-43d9-b528-d17834172010 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:18.799254 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-053ffac2-3dff-49bf-b69c-7bbcb8cb844c req-c01ddded-12ab-4ed4-83bc-e42312268083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4809e1f-dcaa-4f5b-833e-5a2490d48732", "tag": "75dbb744-8992-4d1d-8115-b6514fa8aabd"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:00:18.805182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be05c0c7-2a25-43d9-b528-d17834172010 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:18.805776 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be05c0c7-2a25-43d9-b528-d17834172010 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:18.806553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be05c0c7-2a25-43d9-b528-d17834172010 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:18.807380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be05c0c7-2a25-43d9-b528-d17834172010 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:18.807948 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be05c0c7-2a25-43d9-b528-d17834172010 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:18.808508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-be05c0c7-2a25-43d9-b528-d17834172010 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:18.810047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-053ffac2-3dff-49bf-b69c-7bbcb8cb844c req-c01ddded-12ab-4ed4-83bc-e42312268083 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:18.810736 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-053ffac2-3dff-49bf-b69c-7bbcb8cb844c req-c01ddded-12ab-4ed4-83bc-e42312268083 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:18.811199 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-053ffac2-3dff-49bf-b69c-7bbcb8cb844c req-c01ddded-12ab-4ed4-83bc-e42312268083 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:18.822705 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-053ffac2-3dff-49bf-b69c-7bbcb8cb844c req-c01ddded-12ab-4ed4-83bc-e42312268083 service nova] Creating event network-changed:75dbb744-8992-4d1d-8115-b6514fa8aabd for instance e4809e1f-dcaa-4f5b-833e-5a2490d48732 on hv-cinder-85426 Aug 24 06:00:18.827836 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-053ffac2-3dff-49bf-b69c-7bbcb8cb844c req-c01ddded-12ab-4ed4-83bc-e42312268083 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033379 Aug 24 06:00:18.828496 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 601/1246] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:00:18.839939 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-be05c0c7-2a25-43d9-b528-d17834172010 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Going to try to terminate instance {{(pid=127756) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:00:19.264459 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-be05c0c7-2a25-43d9-b528-d17834172010 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 204 len: 0 microversion: 2.1 time: 0.466304 Aug 24 06:00:19.265427 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 646/1247] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 06:00:18 2022] DELETE /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:00:19.275586 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c44ebd37-cd61-4fc5-b782-2d8221f6429f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:19.276423 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c44ebd37-cd61-4fc5-b782-2d8221f6429f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:19.284729 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c44ebd37-cd61-4fc5-b782-2d8221f6429f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:19.285516 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c44ebd37-cd61-4fc5-b782-2d8221f6429f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:19.286277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c44ebd37-cd61-4fc5-b782-2d8221f6429f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:19.287330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c44ebd37-cd61-4fc5-b782-2d8221f6429f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:19.287951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c44ebd37-cd61-4fc5-b782-2d8221f6429f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:19.288585 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c44ebd37-cd61-4fc5-b782-2d8221f6429f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:19.446003 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c44ebd37-cd61-4fc5-b782-2d8221f6429f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:19.455349 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c44ebd37-cd61-4fc5-b782-2d8221f6429f tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1575 microversion: 2.1 time: 0.184048 Aug 24 06:00:19.460564 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 602/1248] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:19 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:20.481735 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-66af2385-e6fc-4882-b134-e45b16c4f952 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:20.482480 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-66af2385-e6fc-4882-b134-e45b16c4f952 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:20.491861 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66af2385-e6fc-4882-b134-e45b16c4f952 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:20.492358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66af2385-e6fc-4882-b134-e45b16c4f952 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:20.492834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66af2385-e6fc-4882-b134-e45b16c4f952 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:20.493543 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66af2385-e6fc-4882-b134-e45b16c4f952 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:20.494005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66af2385-e6fc-4882-b134-e45b16c4f952 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:20.494435 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66af2385-e6fc-4882-b134-e45b16c4f952 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:20.631046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66af2385-e6fc-4882-b134-e45b16c4f952 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:20.639693 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-66af2385-e6fc-4882-b134-e45b16c4f952 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1457 microversion: 2.1 time: 0.162212 Aug 24 06:00:20.640630 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 647/1249] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:20 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1457 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:20.873467 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-ee0b2f01-4232-48c3-8e8d-86250a8c1d75 req-d6f1781e-ee34-416c-9074-9ee33133a723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4809e1f-dcaa-4f5b-833e-5a2490d48732", "name": "network-vif-deleted", "tag": "75dbb744-8992-4d1d-8115-b6514fa8aabd"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:00:20.884222 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-ee0b2f01-4232-48c3-8e8d-86250a8c1d75 req-d6f1781e-ee34-416c-9074-9ee33133a723 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:20.884734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-ee0b2f01-4232-48c3-8e8d-86250a8c1d75 req-d6f1781e-ee34-416c-9074-9ee33133a723 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:20.885160 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-ee0b2f01-4232-48c3-8e8d-86250a8c1d75 req-d6f1781e-ee34-416c-9074-9ee33133a723 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:20.896724 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-ee0b2f01-4232-48c3-8e8d-86250a8c1d75 req-d6f1781e-ee34-416c-9074-9ee33133a723 service nova] Creating event network-vif-deleted:75dbb744-8992-4d1d-8115-b6514fa8aabd for instance e4809e1f-dcaa-4f5b-833e-5a2490d48732 on hv-cinder-85426 Aug 24 06:00:20.901483 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-ee0b2f01-4232-48c3-8e8d-86250a8c1d75 req-d6f1781e-ee34-416c-9074-9ee33133a723 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031749 Aug 24 06:00:20.902181 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 603/1250] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:00:21.544264 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7dc0c7f0-5f7d-46c2-a909-cc1a6bad0c46 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:21.544898 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7dc0c7f0-5f7d-46c2-a909-cc1a6bad0c46 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:21.552910 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dc0c7f0-5f7d-46c2-a909-cc1a6bad0c46 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:21.553520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dc0c7f0-5f7d-46c2-a909-cc1a6bad0c46 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:21.554053 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dc0c7f0-5f7d-46c2-a909-cc1a6bad0c46 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:21.554823 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dc0c7f0-5f7d-46c2-a909-cc1a6bad0c46 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:21.555273 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dc0c7f0-5f7d-46c2-a909-cc1a6bad0c46 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:21.555692 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7dc0c7f0-5f7d-46c2-a909-cc1a6bad0c46 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:21.640183 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-7dc0c7f0-5f7d-46c2-a909-cc1a6bad0c46 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lazy-loading 'services' on Instance uuid c1056162-0a25-4f9a-878f-4cd2beba5939 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:00:21.663334 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:21.664366 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:21.672422 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:21.673931 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:21.674795 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:21.675939 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:21.676741 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:21.677233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:21.713151 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:21.713747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:21.714187 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:21.714845 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lazy-loading 'fault' on Instance uuid e4809e1f-dcaa-4f5b-833e-5a2490d48732 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:00:21.759911 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:21.766278 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6afab5bc-de97-47d6-8e6e-57de851186f5 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1230 microversion: 2.1 time: 0.107982 Aug 24 06:00:21.766875 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 604/1251] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:21 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:00:22.062668 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7dc0c7f0-5f7d-46c2-a909-cc1a6bad0c46 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939/os-volume_attachments/782d3752-28c6-4fa5-b48b-525574be74e8" status: 202 len: 0 microversion: 2.1 time: 0.523959 Aug 24 06:00:22.064718 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 648/1252] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 06:00:21 2022] DELETE /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939/os-volume_attachments/782d3752-28c6-4fa5-b48b-525574be74e8 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:00:22.787248 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:22.787875 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:22.794558 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:22.794952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:22.795403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:22.796112 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:22.796603 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:22.797035 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:22.831671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:22.832161 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:22.832638 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:22.833088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lazy-loading 'fault' on Instance uuid e4809e1f-dcaa-4f5b-833e-5a2490d48732 {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:00:22.882013 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92925514b544fbe9e34326f9c48cb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dbc250d3447ecbd8c7b6df2d10d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:22.889208 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-80a512d2-e28d-41d6-8738-e92c33cf4235 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 200 len: 1184 microversion: 2.1 time: 0.105855 Aug 24 06:00:22.889771 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 605/1253] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:22 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 1184 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:23.912209 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:23.912940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: e4809e1f-dcaa-4f5b-833e-5a2490d48732] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:23.919078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:23.919566 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:23.920006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:23.920727 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:23.921186 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:23.926908 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:23.935878 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] HTTP exception thrown: Instance e4809e1f-dcaa-4f5b-833e-5a2490d48732 could not be found. Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Request method failure captured: Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 HTTP/1.1 Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbu8dOm3pONZeIx1jm41sC2N19NTM9c2O2gbdu8wWljUb9dfKKLzEQgV6V8eIxiMDIZk8bRAVSGnIv1ojnl-i-wfrjAmSAD5bWbO5xE_bUuADpUEWkm8NZ1lfDs_2A_KrShF9bSCJ5ctj6no6GXNNDfWa2p9q_kagE6Yuy0KpiOIjs0 Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 8e8dbc250d3447ecbd8c7b6df2d10d2c Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 06:00:23.937678 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}] Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 8e8dbc250d3447ecbd8c7b6df2d10d2c Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-TestVolumeBootPattern-1103499817-project Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: b92925514b544fbe9e34326f9c48cb24 Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-TestVolumeBootPattern-1103499817-project Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance e4809e1f-dcaa-4f5b-833e-5a2490d48732 could not be found. Aug 24 06:00:23.940390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': 'e4809e1f-dcaa-4f5b-833e-5a2490d48732'} Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4809e1f-dcaa-4f5b-833e-5a2490d48732 could not be found. Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:00:23.941361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4809e1f-dcaa-4f5b-833e-5a2490d48732 could not be found. Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4809e1f-dcaa-4f5b-833e-5a2490d48732 could not be found. Aug 24 06:00:23.942959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:23.944694 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Returning 404 to user: Instance e4809e1f-dcaa-4f5b-833e-5a2490d48732 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:00:23.944694 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-15908c58-f0ec-4313-a566-9525910dd947 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732" status: 404 len: 111 microversion: 2.1 time: 0.032728 Aug 24 06:00:23.944694 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 649/1254] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:23 2022] GET /compute/v2.1/servers/e4809e1f-dcaa-4f5b-833e-5a2490d48732 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:00:24.248434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-5fb68b01-b286-4498-b0e5-af0e8815120e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:24.251906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5fb68b01-b286-4498-b0e5-af0e8815120e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:24.256072 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5fb68b01-b286-4498-b0e5-af0e8815120e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:24.256649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5fb68b01-b286-4498-b0e5-af0e8815120e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:24.257137 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5fb68b01-b286-4498-b0e5-af0e8815120e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:24.257831 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5fb68b01-b286-4498-b0e5-af0e8815120e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:24.258279 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5fb68b01-b286-4498-b0e5-af0e8815120e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:24.258769 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5fb68b01-b286-4498-b0e5-af0e8815120e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:24.286233 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5fb68b01-b286-4498-b0e5-af0e8815120e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:00:24.466269 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:24.466770 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:24.472957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:24.475729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:24.475729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:24.475729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:24.475729 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:24.476122 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:24.491229 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] HTTP exception thrown: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Request method failure captured: Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: DELETE /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 HTTP/1.1 Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbu8dOm3pONZeIx1jm41sC2N19NTM9c2O2gbdu8wWljUb9dfKKLzEQgV6V8eIxiMDIZk8bRAVSGnIv1ojnl-i-wfrjAmSAD5bWbO5xE_bUuADpUEWkm8NZ1lfDs_2A_KrShF9bSCJ5ctj6no6GXNNDfWa2p9q_kagE6Yuy0KpiOIjs0 Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 8e8dbc250d3447ecbd8c7b6df2d10d2c Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 06:00:24.492893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}] Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 8e8dbc250d3447ecbd8c7b6df2d10d2c Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-TestVolumeBootPattern-1103499817-project Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: b92925514b544fbe9e34326f9c48cb24 Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-TestVolumeBootPattern-1103499817-project Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 06:00:24.494351 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '97293205-ac16-434c-bdc0-12c736460ba3'} Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:00:24.495159 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 06:00:24.496447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:24.498408 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Returning 404 to user: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:00:24.498408 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0ff37be3-b7ea-4ba7-803f-aade113d1e85 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "DELETE /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 404 len: 111 microversion: 2.1 time: 0.031912 Aug 24 06:00:24.498408 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 650/1255] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 06:00:24 2022] DELETE /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:00:24.503835 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:24.504469 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] [instance: 97293205-ac16-434c-bdc0-12c736460ba3] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:24.510392 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:24.510871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:24.511305 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:24.511991 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:24.512524 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:24.512953 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:24.526846 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] HTTP exception thrown: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Request method failure captured: Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 HTTP/1.1 Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbu8dOm3pONZeIx1jm41sC2N19NTM9c2O2gbdu8wWljUb9dfKKLzEQgV6V8eIxiMDIZk8bRAVSGnIv1ojnl-i-wfrjAmSAD5bWbO5xE_bUuADpUEWkm8NZ1lfDs_2A_KrShF9bSCJ5ctj6no6GXNNDfWa2p9q_kagE6Yuy0KpiOIjs0 Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 8e8dbc250d3447ecbd8c7b6df2d10d2c Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 06:00:24.528380 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8e8dbc250d3447ecbd8c7b6df2d10d2c"}]}] Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 8e8dbc250d3447ecbd8c7b6df2d10d2c Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-TestVolumeBootPattern-1103499817 Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-TestVolumeBootPattern-1103499817-project Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: b92925514b544fbe9e34326f9c48cb24 Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-TestVolumeBootPattern-1103499817-project Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 06:00:24.529997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '97293205-ac16-434c-bdc0-12c736460ba3'} Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:00:24.530929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. Aug 24 06:00:24.532959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:24.534346 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Returning 404 to user: Instance 97293205-ac16-434c-bdc0-12c736460ba3 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:00:24.534346 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-252d9fd6-c236-4d6b-b5fd-e57a0b566e94 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3" status: 404 len: 111 microversion: 2.1 time: 0.030597 Aug 24 06:00:24.534346 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 651/1256] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:24 2022] GET /compute/v2.1/servers/97293205-ac16-434c-bdc0-12c736460ba3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:00:24.585556 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-5fb68b01-b286-4498-b0e5-af0e8815120e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 204 len: 0 microversion: 2.1 time: 0.340666 Aug 24 06:00:24.586153 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 606/1257] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 06:00:24 2022] DELETE /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:00:24.594605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-e631a697-abe3-4cb7-aeef-d788281d4d04 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:24.601465 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-e631a697-abe3-4cb7-aeef-d788281d4d04 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:24.601465 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e631a697-abe3-4cb7-aeef-d788281d4d04 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:24.601869 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e631a697-abe3-4cb7-aeef-d788281d4d04 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:24.602315 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e631a697-abe3-4cb7-aeef-d788281d4d04 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:24.602995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e631a697-abe3-4cb7-aeef-d788281d4d04 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:24.603449 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e631a697-abe3-4cb7-aeef-d788281d4d04 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:24.603876 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-e631a697-abe3-4cb7-aeef-d788281d4d04 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:24.737417 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-e631a697-abe3-4cb7-aeef-d788281d4d04 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:24.745182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-e631a697-abe3-4cb7-aeef-d788281d4d04 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1514 microversion: 2.1 time: 0.154431 Aug 24 06:00:24.745745 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 652/1258] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:24 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:25.767656 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f3bc2784-9879-4681-8b3d-3a357c6a193e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:25.768367 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f3bc2784-9879-4681-8b3d-3a357c6a193e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:25.774891 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3bc2784-9879-4681-8b3d-3a357c6a193e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:25.775391 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3bc2784-9879-4681-8b3d-3a357c6a193e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:25.775831 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3bc2784-9879-4681-8b3d-3a357c6a193e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:25.776569 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3bc2784-9879-4681-8b3d-3a357c6a193e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:25.777030 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3bc2784-9879-4681-8b3d-3a357c6a193e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:25.777466 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f3bc2784-9879-4681-8b3d-3a357c6a193e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:25.914457 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f3bc2784-9879-4681-8b3d-3a357c6a193e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:25.924178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f3bc2784-9879-4681-8b3d-3a357c6a193e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1514 microversion: 2.1 time: 0.160934 Aug 24 06:00:25.940341 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 607/1259] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:25 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:26.128355 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1e2bbf54-e5af-4126-8b22-e41d13dacb31 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] Calling method '.version_select at 0x7f065c203940>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:26.215012 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1e2bbf54-e5af-4126-8b22-e41d13dacb31 tempest-TestVolumeBootPattern-1103499817 tempest-TestVolumeBootPattern-1103499817-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1642854592" status: 202 len: 0 microversion: 2.1 time: 0.091152 Aug 24 06:00:26.215763 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 653/1260] 10.222.0.15 () {58 vars in 1263 bytes} [Wed Aug 24 06:00:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1642854592 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:00:26.947274 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-bbf4598b-c3fe-4af6-873e-91483b1bdbbe tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:26.947911 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-bbf4598b-c3fe-4af6-873e-91483b1bdbbe tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:26.955505 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbf4598b-c3fe-4af6-873e-91483b1bdbbe tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:26.955985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbf4598b-c3fe-4af6-873e-91483b1bdbbe tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:26.956440 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbf4598b-c3fe-4af6-873e-91483b1bdbbe tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:26.957141 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbf4598b-c3fe-4af6-873e-91483b1bdbbe tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:26.957593 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbf4598b-c3fe-4af6-873e-91483b1bdbbe tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:26.958015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bbf4598b-c3fe-4af6-873e-91483b1bdbbe tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:27.113171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-bbf4598b-c3fe-4af6-873e-91483b1bdbbe tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:27.117301 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:27.123087 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-bbf4598b-c3fe-4af6-873e-91483b1bdbbe tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1514 microversion: 2.1 time: 0.179065 Aug 24 06:00:27.123087 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 608/1261] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:26 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:28.081724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-814ccc3b-f541-4638-bee2-3cd257d71e6f req-7a4edcae-6e2e-4c88-bf36-eeec67ffc7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1056162-0a25-4f9a-878f-4cd2beba5939", "name": "network-vif-deleted", "tag": "c7cb7a1a-af2f-493e-a98f-f1a5d64bcfe2"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:00:28.096464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-814ccc3b-f541-4638-bee2-3cd257d71e6f req-7a4edcae-6e2e-4c88-bf36-eeec67ffc7b8 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:28.097174 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-814ccc3b-f541-4638-bee2-3cd257d71e6f req-7a4edcae-6e2e-4c88-bf36-eeec67ffc7b8 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:28.097696 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-814ccc3b-f541-4638-bee2-3cd257d71e6f req-7a4edcae-6e2e-4c88-bf36-eeec67ffc7b8 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:28.110950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-814ccc3b-f541-4638-bee2-3cd257d71e6f req-7a4edcae-6e2e-4c88-bf36-eeec67ffc7b8 service nova] Creating event network-vif-deleted:c7cb7a1a-af2f-493e-a98f-f1a5d64bcfe2 for instance c1056162-0a25-4f9a-878f-4cd2beba5939 on hv-cinder-85426 Aug 24 06:00:28.129042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-814ccc3b-f541-4638-bee2-3cd257d71e6f req-7a4edcae-6e2e-4c88-bf36-eeec67ffc7b8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052305 Aug 24 06:00:28.129959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 654/1262] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:00:28.148182 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-613426aa-89e0-48a0-ac32-898582b60794 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:28.148842 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-613426aa-89e0-48a0-ac32-898582b60794 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:28.162695 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-613426aa-89e0-48a0-ac32-898582b60794 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:28.163196 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-613426aa-89e0-48a0-ac32-898582b60794 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:28.163639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-613426aa-89e0-48a0-ac32-898582b60794 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:28.168508 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-613426aa-89e0-48a0-ac32-898582b60794 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:28.168992 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-613426aa-89e0-48a0-ac32-898582b60794 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:28.169433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-613426aa-89e0-48a0-ac32-898582b60794 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:28.241946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-613426aa-89e0-48a0-ac32-898582b60794 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:28.250271 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-613426aa-89e0-48a0-ac32-898582b60794 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 200 len: 1472 microversion: 2.1 time: 0.109106 Aug 24 06:00:28.250883 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 609/1263] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:28 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 1472 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:29.273826 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:29.274644 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: c1056162-0a25-4f9a-878f-4cd2beba5939] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:29.283904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:29.284506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:29.285036 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:29.285857 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:29.286390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:29.286895 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:29.306031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] HTTP exception thrown: Instance c1056162-0a25-4f9a-878f-4cd2beba5939 could not be found. Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Request method failure captured: Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 HTTP/1.1 Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBb4fpftLisGQURUVd9LoFu2phldXYJK6MuiK68tqfHuE9RoGmIUWHVjvpBO5d-XclMHOc0BooE71XS1hdiPaD4E8ODam-mF3uX1flaxKw6YFZj2Bs8P1mwJzwsQme4vYHE2Bw_e_SxxAF3IsFoDALw_mtsbE2fCkwoGezuT1J1Jz-xE Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 4c6ba7a7881546eea41c15fa4c6e0244 Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-VolumesSnapshotTestJSON-979470569 Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 06:00:29.308043 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4c6ba7a7881546eea41c15fa4c6e0244"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4c6ba7a7881546eea41c15fa4c6e0244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4c6ba7a7881546eea41c15fa4c6e0244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4c6ba7a7881546eea41c15fa4c6e0244"}]}] Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-VolumesSnapshotTestJSON-979470569 Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 4c6ba7a7881546eea41c15fa4c6e0244 Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-979470569 Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-VolumesSnapshotTestJSON-979470569-project Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 89b5395d46bf4d55bbce8e30198eab6d Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-VolumesSnapshotTestJSON-979470569-project Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance c1056162-0a25-4f9a-878f-4cd2beba5939 could not be found. Aug 24 06:00:29.309567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': 'c1056162-0a25-4f9a-878f-4cd2beba5939'} Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1056162-0a25-4f9a-878f-4cd2beba5939 could not be found. Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:00:29.310410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1056162-0a25-4f9a-878f-4cd2beba5939 could not be found. Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1056162-0a25-4f9a-878f-4cd2beba5939 could not be found. Aug 24 06:00:29.311742 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:00:29.313458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Returning 404 to user: Instance c1056162-0a25-4f9a-878f-4cd2beba5939 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:00:29.313458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3d1cd2fd-c090-4435-b2ef-6aa12b2352cf tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939" status: 404 len: 111 microversion: 2.1 time: 0.040753 Aug 24 06:00:29.313458 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 655/1264] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:29 2022] GET /compute/v2.1/servers/c1056162-0a25-4f9a-878f-4cd2beba5939 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:00:42.397145 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1860683783", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "networks": [{"uuid": "8e4d81d0-5c97-44ce-8527-aee49bb9fb6b"}]}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:00:42.405820 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:42.452478 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] validate_networks() for [('8e4d81d0-5c97-44ce-8527-aee49bb9fb6b', None, None, None, None, None)] {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:00:42.950016 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:00:42.950439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:00:42.950912 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:00:42.951319 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:00:42.951761 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:00:42.962079 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:42.962534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:42.962976 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:42.963749 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:42.964195 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:42.964650 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:42.982435 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Getting quotas for project 4c6ba7a7881546eea41c15fa4c6e0244. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:00:42.987606 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Getting quotas for user 89b5395d46bf4d55bbce8e30198eab6d and project 4c6ba7a7881546eea41c15fa4c6e0244. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:00:42.999051 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:00:43.002012 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:00:43.212530 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b7ed1ccd-a5e7-4834-8b85-6e5f60c6eade tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819163 Aug 24 06:00:43.213898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 610/1265] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 06:00:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:00:43.227567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-db9a5d10-2ee1-4ed0-a449-5d16f10dacd5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:43.228212 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-db9a5d10-2ee1-4ed0-a449-5d16f10dacd5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:43.232340 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:43.233654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:43.310551 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-db9a5d10-2ee1-4ed0-a449-5d16f10dacd5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:43.319141 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-db9a5d10-2ee1-4ed0-a449-5d16f10dacd5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1219 microversion: 2.1 time: 0.096057 Aug 24 06:00:43.332996 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 656/1266] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:43 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:44.341917 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c26ae546-3d82-4004-8dc5-e832681486e7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:44.342560 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c26ae546-3d82-4004-8dc5-e832681486e7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:44.350126 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c26ae546-3d82-4004-8dc5-e832681486e7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:44.350619 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c26ae546-3d82-4004-8dc5-e832681486e7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:44.351206 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c26ae546-3d82-4004-8dc5-e832681486e7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:44.351913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c26ae546-3d82-4004-8dc5-e832681486e7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:44.352375 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c26ae546-3d82-4004-8dc5-e832681486e7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:44.352831 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c26ae546-3d82-4004-8dc5-e832681486e7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:44.418927 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c26ae546-3d82-4004-8dc5-e832681486e7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:44.427367 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c26ae546-3d82-4004-8dc5-e832681486e7 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1223 microversion: 2.1 time: 0.092205 Aug 24 06:00:44.427937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 611/1267] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:44 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:45.449245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1b392ae9-8fe2-42de-9499-fc3f9f874206 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:45.449850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1b392ae9-8fe2-42de-9499-fc3f9f874206 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:45.458087 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b392ae9-8fe2-42de-9499-fc3f9f874206 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:45.458562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b392ae9-8fe2-42de-9499-fc3f9f874206 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:45.459002 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b392ae9-8fe2-42de-9499-fc3f9f874206 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:45.459719 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b392ae9-8fe2-42de-9499-fc3f9f874206 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:45.460172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b392ae9-8fe2-42de-9499-fc3f9f874206 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:45.460625 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1b392ae9-8fe2-42de-9499-fc3f9f874206 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:45.521489 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1b392ae9-8fe2-42de-9499-fc3f9f874206 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:45.529140 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1b392ae9-8fe2-42de-9499-fc3f9f874206 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1271 microversion: 2.1 time: 0.084572 Aug 24 06:00:45.529711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 657/1268] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:45 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:46.555532 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-24ff3b76-ac5e-4a0f-ad9b-66a36828e74e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:46.556878 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-24ff3b76-ac5e-4a0f-ad9b-66a36828e74e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:46.569851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24ff3b76-ac5e-4a0f-ad9b-66a36828e74e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:46.569851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24ff3b76-ac5e-4a0f-ad9b-66a36828e74e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:46.569851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24ff3b76-ac5e-4a0f-ad9b-66a36828e74e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:46.569851 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24ff3b76-ac5e-4a0f-ad9b-66a36828e74e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:46.570376 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24ff3b76-ac5e-4a0f-ad9b-66a36828e74e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:46.570376 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24ff3b76-ac5e-4a0f-ad9b-66a36828e74e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:46.706151 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-24ff3b76-ac5e-4a0f-ad9b-66a36828e74e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:46.714606 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-24ff3b76-ac5e-4a0f-ad9b-66a36828e74e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1319 microversion: 2.1 time: 0.164523 Aug 24 06:00:46.715175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 612/1269] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:46 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:47.458249 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-3613b028-ba5c-4314-8d8f-e4f11623d0de req-62cb2d04-6955-4f43-befb-0234418802f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a10b0c1-3cc4-4b01-9505-f1280f4d5823", "tag": "9fdaaddd-48e7-476f-b235-b28339c385d9"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:00:47.469310 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-3613b028-ba5c-4314-8d8f-e4f11623d0de req-62cb2d04-6955-4f43-befb-0234418802f4 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:47.469788 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-3613b028-ba5c-4314-8d8f-e4f11623d0de req-62cb2d04-6955-4f43-befb-0234418802f4 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:47.470221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-3613b028-ba5c-4314-8d8f-e4f11623d0de req-62cb2d04-6955-4f43-befb-0234418802f4 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:47.481999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-3613b028-ba5c-4314-8d8f-e4f11623d0de req-62cb2d04-6955-4f43-befb-0234418802f4 service nova] Creating event network-changed:9fdaaddd-48e7-476f-b235-b28339c385d9 for instance 7a10b0c1-3cc4-4b01-9505-f1280f4d5823 on hv-cinder-85426 Aug 24 06:00:47.487116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-3613b028-ba5c-4314-8d8f-e4f11623d0de req-62cb2d04-6955-4f43-befb-0234418802f4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032658 Aug 24 06:00:47.487719 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 658/1270] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:00:47.736420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0d3a7dcb-f70b-4cb3-99fb-52e530c3000b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:47.736957 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0d3a7dcb-f70b-4cb3-99fb-52e530c3000b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:47.744229 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0d3a7dcb-f70b-4cb3-99fb-52e530c3000b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:47.744756 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0d3a7dcb-f70b-4cb3-99fb-52e530c3000b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:47.745201 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0d3a7dcb-f70b-4cb3-99fb-52e530c3000b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:47.745898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0d3a7dcb-f70b-4cb3-99fb-52e530c3000b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:47.746361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0d3a7dcb-f70b-4cb3-99fb-52e530c3000b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:47.746790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0d3a7dcb-f70b-4cb3-99fb-52e530c3000b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:47.873926 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0d3a7dcb-f70b-4cb3-99fb-52e530c3000b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:47.881612 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0d3a7dcb-f70b-4cb3-99fb-52e530c3000b tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1319 microversion: 2.1 time: 0.149163 Aug 24 06:00:47.882175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 613/1271] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:47 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:48.903685 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b995c980-2415-48f3-894e-a601f612c768 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:48.904299 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b995c980-2415-48f3-894e-a601f612c768 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:48.910584 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b995c980-2415-48f3-894e-a601f612c768 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:48.911784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b995c980-2415-48f3-894e-a601f612c768 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:48.912215 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b995c980-2415-48f3-894e-a601f612c768 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:48.912956 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b995c980-2415-48f3-894e-a601f612c768 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:48.913411 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b995c980-2415-48f3-894e-a601f612c768 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:48.913835 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b995c980-2415-48f3-894e-a601f612c768 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:49.042973 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-b995c980-2415-48f3-894e-a601f612c768 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:49.050586 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b995c980-2415-48f3-894e-a601f612c768 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1319 microversion: 2.1 time: 0.152078 Aug 24 06:00:49.051146 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 659/1272] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:48 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:50.071049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-fdff64db-199b-46c8-9ed0-d86a6c333171 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:50.071663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-fdff64db-199b-46c8-9ed0-d86a6c333171 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:50.078413 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fdff64db-199b-46c8-9ed0-d86a6c333171 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:50.078894 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fdff64db-199b-46c8-9ed0-d86a6c333171 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:50.079331 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fdff64db-199b-46c8-9ed0-d86a6c333171 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:50.080017 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fdff64db-199b-46c8-9ed0-d86a6c333171 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:50.080495 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fdff64db-199b-46c8-9ed0-d86a6c333171 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:50.080920 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fdff64db-199b-46c8-9ed0-d86a6c333171 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:50.209082 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fdff64db-199b-46c8-9ed0-d86a6c333171 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:50.216693 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-fdff64db-199b-46c8-9ed0-d86a6c333171 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1319 microversion: 2.1 time: 0.149518 Aug 24 06:00:50.217253 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 614/1273] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:50 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:51.237826 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-13387200-e56c-4101-a6f5-fa02a2f2d061 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:51.238551 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-13387200-e56c-4101-a6f5-fa02a2f2d061 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:51.245762 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13387200-e56c-4101-a6f5-fa02a2f2d061 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:51.246246 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13387200-e56c-4101-a6f5-fa02a2f2d061 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:51.246692 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13387200-e56c-4101-a6f5-fa02a2f2d061 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:51.247390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13387200-e56c-4101-a6f5-fa02a2f2d061 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:51.247845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13387200-e56c-4101-a6f5-fa02a2f2d061 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:51.248270 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-13387200-e56c-4101-a6f5-fa02a2f2d061 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:51.377824 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-13387200-e56c-4101-a6f5-fa02a2f2d061 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:51.386226 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-13387200-e56c-4101-a6f5-fa02a2f2d061 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1319 microversion: 2.1 time: 0.152341 Aug 24 06:00:51.386789 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 660/1274] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:51 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:52.407145 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-89b82c47-9c73-4fb6-8a55-48ba10b339e3 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:52.407782 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-89b82c47-9c73-4fb6-8a55-48ba10b339e3 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:52.414312 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89b82c47-9c73-4fb6-8a55-48ba10b339e3 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:52.414790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89b82c47-9c73-4fb6-8a55-48ba10b339e3 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:52.415229 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89b82c47-9c73-4fb6-8a55-48ba10b339e3 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:52.415943 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89b82c47-9c73-4fb6-8a55-48ba10b339e3 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:52.416418 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89b82c47-9c73-4fb6-8a55-48ba10b339e3 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:52.416896 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-89b82c47-9c73-4fb6-8a55-48ba10b339e3 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:52.548956 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-89b82c47-9c73-4fb6-8a55-48ba10b339e3 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:52.556778 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-89b82c47-9c73-4fb6-8a55-48ba10b339e3 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1319 microversion: 2.1 time: 0.153730 Aug 24 06:00:52.557347 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 615/1275] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:52 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:53.577735 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c1dd6fec-319e-4509-abe8-71acde88f7ef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:53.578354 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c1dd6fec-319e-4509-abe8-71acde88f7ef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:53.580827 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:53.586582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1dd6fec-319e-4509-abe8-71acde88f7ef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:53.587069 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1dd6fec-319e-4509-abe8-71acde88f7ef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:53.587515 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1dd6fec-319e-4509-abe8-71acde88f7ef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:53.588252 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1dd6fec-319e-4509-abe8-71acde88f7ef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:53.588748 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1dd6fec-319e-4509-abe8-71acde88f7ef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:53.589180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c1dd6fec-319e-4509-abe8-71acde88f7ef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:53.719997 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c1dd6fec-319e-4509-abe8-71acde88f7ef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:53.728540 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c1dd6fec-319e-4509-abe8-71acde88f7ef tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1319 microversion: 2.1 time: 0.154753 Aug 24 06:00:53.729101 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 661/1276] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:53 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:54.749031 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-a42bb260-829c-466d-928f-a406571a72c5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:54.749661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-a42bb260-829c-466d-928f-a406571a72c5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:54.751534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:54.752186 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=6 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:54.757502 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a42bb260-829c-466d-928f-a406571a72c5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:54.757979 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a42bb260-829c-466d-928f-a406571a72c5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:54.758408 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a42bb260-829c-466d-928f-a406571a72c5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:54.759087 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a42bb260-829c-466d-928f-a406571a72c5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:54.759579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a42bb260-829c-466d-928f-a406571a72c5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:54.760001 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-a42bb260-829c-466d-928f-a406571a72c5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:54.891668 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-a42bb260-829c-466d-928f-a406571a72c5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:54.899913 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-a42bb260-829c-466d-928f-a406571a72c5 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1319 microversion: 2.1 time: 0.154801 Aug 24 06:00:54.900495 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 616/1277] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:54 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:55.714362 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-77b0d8a0-00e1-4006-8141-3717567a8b88 req-abf57677-5bf8-48d5-bd82-5dbe43bc98b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a10b0c1-3cc4-4b01-9505-f1280f4d5823", "name": "network-vif-plugged", "status": "completed", "tag": "9fdaaddd-48e7-476f-b235-b28339c385d9"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:00:55.724444 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-77b0d8a0-00e1-4006-8141-3717567a8b88 req-abf57677-5bf8-48d5-bd82-5dbe43bc98b6 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:55.724940 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-77b0d8a0-00e1-4006-8141-3717567a8b88 req-abf57677-5bf8-48d5-bd82-5dbe43bc98b6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:55.725374 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-77b0d8a0-00e1-4006-8141-3717567a8b88 req-abf57677-5bf8-48d5-bd82-5dbe43bc98b6 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:55.736241 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-77b0d8a0-00e1-4006-8141-3717567a8b88 req-abf57677-5bf8-48d5-bd82-5dbe43bc98b6 service nova] Creating event network-vif-plugged:9fdaaddd-48e7-476f-b235-b28339c385d9 for instance 7a10b0c1-3cc4-4b01-9505-f1280f4d5823 on hv-cinder-85426 Aug 24 06:00:55.741432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-77b0d8a0-00e1-4006-8141-3717567a8b88 req-abf57677-5bf8-48d5-bd82-5dbe43bc98b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147727 Aug 24 06:00:55.742235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 662/1278] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:00:55.921413 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8d749f2a-bfcd-432c-bb81-0294e8309498 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:55.922028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8d749f2a-bfcd-432c-bb81-0294e8309498 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:55.930120 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8d749f2a-bfcd-432c-bb81-0294e8309498 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:55.930543 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8d749f2a-bfcd-432c-bb81-0294e8309498 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:55.930985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8d749f2a-bfcd-432c-bb81-0294e8309498 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:55.931696 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8d749f2a-bfcd-432c-bb81-0294e8309498 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:55.932158 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8d749f2a-bfcd-432c-bb81-0294e8309498 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:55.932652 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8d749f2a-bfcd-432c-bb81-0294e8309498 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:56.070461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8d749f2a-bfcd-432c-bb81-0294e8309498 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:56.078194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8d749f2a-bfcd-432c-bb81-0294e8309498 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1319 microversion: 2.1 time: 0.160677 Aug 24 06:00:56.078765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 617/1279] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:55 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:57.098941 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-64189d29-0f2c-483d-865e-920a319ed1c0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:57.099665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-64189d29-0f2c-483d-865e-920a319ed1c0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:57.105811 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64189d29-0f2c-483d-865e-920a319ed1c0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:57.106355 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64189d29-0f2c-483d-865e-920a319ed1c0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:57.106717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64189d29-0f2c-483d-865e-920a319ed1c0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:57.107403 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64189d29-0f2c-483d-865e-920a319ed1c0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:57.107857 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64189d29-0f2c-483d-865e-920a319ed1c0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:57.108281 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-64189d29-0f2c-483d-865e-920a319ed1c0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:57.244615 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-64189d29-0f2c-483d-865e-920a319ed1c0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:57.252452 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-64189d29-0f2c-483d-865e-920a319ed1c0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1319 microversion: 2.1 time: 0.158185 Aug 24 06:00:57.253031 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 663/1280] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:57 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:58.276126 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-dace0a5b-4caa-4b2b-ac43-aadbd218714e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:58.277061 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-dace0a5b-4caa-4b2b-ac43-aadbd218714e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:58.284478 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dace0a5b-4caa-4b2b-ac43-aadbd218714e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:58.285088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dace0a5b-4caa-4b2b-ac43-aadbd218714e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:58.286300 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dace0a5b-4caa-4b2b-ac43-aadbd218714e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:58.287036 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dace0a5b-4caa-4b2b-ac43-aadbd218714e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:58.287502 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dace0a5b-4caa-4b2b-ac43-aadbd218714e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:58.287938 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-dace0a5b-4caa-4b2b-ac43-aadbd218714e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:58.425605 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-dace0a5b-4caa-4b2b-ac43-aadbd218714e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:58.433854 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-dace0a5b-4caa-4b2b-ac43-aadbd218714e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1319 microversion: 2.1 time: 0.164313 Aug 24 06:00:58.434420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 618/1281] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:58 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:59.455889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-18d9cf6f-a739-4baa-8c7b-489fd5946cf0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:00:59.456451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-18d9cf6f-a739-4baa-8c7b-489fd5946cf0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:59.463688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-18d9cf6f-a739-4baa-8c7b-489fd5946cf0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:59.464170 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-18d9cf6f-a739-4baa-8c7b-489fd5946cf0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:59.464664 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-18d9cf6f-a739-4baa-8c7b-489fd5946cf0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:59.465363 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-18d9cf6f-a739-4baa-8c7b-489fd5946cf0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:59.465820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-18d9cf6f-a739-4baa-8c7b-489fd5946cf0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:59.466247 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-18d9cf6f-a739-4baa-8c7b-489fd5946cf0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:59.597009 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-18d9cf6f-a739-4baa-8c7b-489fd5946cf0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:00:59.605705 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-18d9cf6f-a739-4baa-8c7b-489fd5946cf0 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1507 microversion: 2.1 time: 0.153895 Aug 24 06:00:59.606271 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 664/1282] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:00:59 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:59.626364 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3fefa0de-d45a-4ae9-9256-5e0ab45eab2e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec417fd0-8130-4917-9d5b-dc36c43515e6", "device": "/dev/sdb"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:00:59.629088 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3fefa0de-d45a-4ae9-9256-5e0ab45eab2e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:00:59.635772 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fefa0de-d45a-4ae9-9256-5e0ab45eab2e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:59.636251 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fefa0de-d45a-4ae9-9256-5e0ab45eab2e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:59.636722 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fefa0de-d45a-4ae9-9256-5e0ab45eab2e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:59.637410 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fefa0de-d45a-4ae9-9256-5e0ab45eab2e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:59.637864 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fefa0de-d45a-4ae9-9256-5e0ab45eab2e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:59.638290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3fefa0de-d45a-4ae9-9256-5e0ab45eab2e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:00.457307 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3fefa0de-d45a-4ae9-9256-5e0ab45eab2e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "POST /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834685 Aug 24 06:01:00.457980 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 619/1283] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 06:00:59 2022] POST /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:01:21.998644 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:01:21.999504 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Wed Aug 24 06:01:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:01:27.087537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a7949291-170b-498d-b424-9f68a7a3e94d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:27.088806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a7949291-170b-498d-b424-9f68a7a3e94d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:27.097097 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=20 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:27.098107 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=40 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:27.099807 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7949291-170b-498d-b424-9f68a7a3e94d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:27.100903 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7949291-170b-498d-b424-9f68a7a3e94d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:27.101520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7949291-170b-498d-b424-9f68a7a3e94d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:27.102735 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7949291-170b-498d-b424-9f68a7a3e94d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:27.103360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7949291-170b-498d-b424-9f68a7a3e94d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:27.103951 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a7949291-170b-498d-b424-9f68a7a3e94d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:27.223921 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-a7949291-170b-498d-b424-9f68a7a3e94d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lazy-loading 'services' on Instance uuid 7a10b0c1-3cc4-4b01-9505-f1280f4d5823 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:01:27.470553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a7949291-170b-498d-b424-9f68a7a3e94d tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823/os-volume_attachments/ec417fd0-8130-4917-9d5b-dc36c43515e6" status: 202 len: 0 microversion: 2.1 time: 0.387384 Aug 24 06:01:27.472428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 665/1284] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 06:01:27 2022] DELETE /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823/os-volume_attachments/ec417fd0-8130-4917-9d5b-dc36c43515e6 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:01:29.585146 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c95a730d-4c59-4cf0-998e-41842a9d4d9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:29.589140 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c95a730d-4c59-4cf0-998e-41842a9d4d9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:29.591919 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:29.592617 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:29.597872 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c95a730d-4c59-4cf0-998e-41842a9d4d9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:29.598365 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c95a730d-4c59-4cf0-998e-41842a9d4d9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:29.599133 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c95a730d-4c59-4cf0-998e-41842a9d4d9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:29.599759 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c95a730d-4c59-4cf0-998e-41842a9d4d9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:29.600860 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c95a730d-4c59-4cf0-998e-41842a9d4d9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:29.601378 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c95a730d-4c59-4cf0-998e-41842a9d4d9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:29.631952 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c95a730d-4c59-4cf0-998e-41842a9d4d9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053277 Aug 24 06:01:29.633322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 620/1285] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 06:01:29 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:01:29.712651 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4b581207-4d97-495e-8462-1a8352b418ff tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:29.713947 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4b581207-4d97-495e-8462-1a8352b418ff tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:29.724949 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1ca1b820-5c88-4ebe-9844-eed4f41ae39a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:29.725602 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1ca1b820-5c88-4ebe-9844-eed4f41ae39a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:29.734014 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ca1b820-5c88-4ebe-9844-eed4f41ae39a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:29.734514 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ca1b820-5c88-4ebe-9844-eed4f41ae39a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:29.739260 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ca1b820-5c88-4ebe-9844-eed4f41ae39a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:29.739260 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ca1b820-5c88-4ebe-9844-eed4f41ae39a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:29.739260 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ca1b820-5c88-4ebe-9844-eed4f41ae39a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:29.739260 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1ca1b820-5c88-4ebe-9844-eed4f41ae39a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:29.742598 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b581207-4d97-495e-8462-1a8352b418ff tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:29.743097 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b581207-4d97-495e-8462-1a8352b418ff tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:29.743541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b581207-4d97-495e-8462-1a8352b418ff tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:29.744255 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b581207-4d97-495e-8462-1a8352b418ff tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:29.744739 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b581207-4d97-495e-8462-1a8352b418ff tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:29.745167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4b581207-4d97-495e-8462-1a8352b418ff tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:29.779811 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1ca1b820-5c88-4ebe-9844-eed4f41ae39a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:01:29.794476 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4b581207-4d97-495e-8462-1a8352b418ff tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Going to try to terminate instance {{(pid=127756) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:01:30.166172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4b581207-4d97-495e-8462-1a8352b418ff tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 204 len: 0 microversion: 2.1 time: 0.458346 Aug 24 06:01:30.167214 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1ca1b820-5c88-4ebe-9844-eed4f41ae39a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "DELETE /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 204 len: 0 microversion: 2.1 time: 0.441707 Aug 24 06:01:30.167588 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 666/1286] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 06:01:29 2022] DELETE /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:01:30.172867 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 621/1287] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 06:01:29 2022] DELETE /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:01:30.177264 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-94b67aa1-b7f4-4183-af66-3dcb290d686a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:30.178220 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-94b67aa1-b7f4-4183-af66-3dcb290d686a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:30.187557 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-94b67aa1-b7f4-4183-af66-3dcb290d686a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:30.189131 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-94b67aa1-b7f4-4183-af66-3dcb290d686a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:30.189749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-94b67aa1-b7f4-4183-af66-3dcb290d686a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:30.190854 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-94b67aa1-b7f4-4183-af66-3dcb290d686a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:30.191757 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-94b67aa1-b7f4-4183-af66-3dcb290d686a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:30.192196 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-94b67aa1-b7f4-4183-af66-3dcb290d686a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:30.194822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-990ecb20-c3f8-46da-95d1-bd3c8c4382d5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:30.199485 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-990ecb20-c3f8-46da-95d1-bd3c8c4382d5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:30.204445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-990ecb20-c3f8-46da-95d1-bd3c8c4382d5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:30.205324 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-990ecb20-c3f8-46da-95d1-bd3c8c4382d5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:30.206079 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-990ecb20-c3f8-46da-95d1-bd3c8c4382d5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:30.207215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-990ecb20-c3f8-46da-95d1-bd3c8c4382d5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:30.210619 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-990ecb20-c3f8-46da-95d1-bd3c8c4382d5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:30.211318 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-990ecb20-c3f8-46da-95d1-bd3c8c4382d5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:30.447536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-990ecb20-c3f8-46da-95d1-bd3c8c4382d5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:30.449058 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-94b67aa1-b7f4-4183-af66-3dcb290d686a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:30.457548 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-94b67aa1-b7f4-4183-af66-3dcb290d686a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1513 microversion: 2.1 time: 0.285145 Aug 24 06:01:30.457822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-990ecb20-c3f8-46da-95d1-bd3c8c4382d5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1674 microversion: 2.1 time: 0.269280 Aug 24 06:01:30.458404 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 622/1288] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:30 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1674 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:30.468967 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 667/1289] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:30 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1513 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:31.341534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9bed3caa-1e4a-4f02-9d46-5225ed4a49cf tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Action: 'create', calling method: .version_select at 0x7f065ca65280>, body: {"keypair": {"name": "tempest-TestShelveInstance-2090955796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACbGZ7v1tv2LwatRcI765KAAxOQ5rVoIEoWxkbYYPmFiKuHIw6dCtcAczuGHgUHb/bP1d4pVyDEAFjZtWUBGwff4zJeweL+LHwISry7aB5ZGAFmminJ/SbxePoMKdBcnQ=="}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:01:31.358211 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-9bed3caa-1e4a-4f02-9d46-5225ed4a49cf tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Getting quotas for project 7373b9ca241b4fbba12f2413458072bb. Resources: {'key_pairs'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:01:31.362359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-9bed3caa-1e4a-4f02-9d46-5225ed4a49cf tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Getting quotas for user 3b4870c15b8149908b6c1a99b1f73bc0 and project 7373b9ca241b4fbba12f2413458072bb. Resources: {'key_pairs'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:01:31.375256 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9bed3caa-1e4a-4f02-9d46-5225ed4a49cf tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [56afe969-a03b-4324-81cd-d737d481e3df] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:01:31.480860 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-66fdee29-45ed-4e67-ba75-3da19e450917 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:31.484654 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-66fdee29-45ed-4e67-ba75-3da19e450917 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:31.487901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66fdee29-45ed-4e67-ba75-3da19e450917 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:31.488390 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66fdee29-45ed-4e67-ba75-3da19e450917 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:31.488858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66fdee29-45ed-4e67-ba75-3da19e450917 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:31.489738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66fdee29-45ed-4e67-ba75-3da19e450917 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:31.490194 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66fdee29-45ed-4e67-ba75-3da19e450917 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:31.491311 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-66fdee29-45ed-4e67-ba75-3da19e450917 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:31.629343 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-66fdee29-45ed-4e67-ba75-3da19e450917 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:31.637708 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-66fdee29-45ed-4e67-ba75-3da19e450917 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1674 microversion: 2.1 time: 0.162419 Aug 24 06:01:31.640568 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 668/1290] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:31 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:01:31.644237 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-891c1ade-6a75-4530-a830-2ac2093a1258 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:31.645109 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-891c1ade-6a75-4530-a830-2ac2093a1258 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:31.652523 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-891c1ade-6a75-4530-a830-2ac2093a1258 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:31.653014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-891c1ade-6a75-4530-a830-2ac2093a1258 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:31.653454 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-891c1ade-6a75-4530-a830-2ac2093a1258 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:31.654158 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-891c1ade-6a75-4530-a830-2ac2093a1258 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:31.654613 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-891c1ade-6a75-4530-a830-2ac2093a1258 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:31.655039 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-891c1ade-6a75-4530-a830-2ac2093a1258 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:31.806920 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-891c1ade-6a75-4530-a830-2ac2093a1258 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:31.817008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-891c1ade-6a75-4530-a830-2ac2093a1258 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1513 microversion: 2.1 time: 0.177230 Aug 24 06:01:31.817588 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 669/1291] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:31 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:32.393295 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [None req-9bed3caa-1e4a-4f02-9d46-5225ed4a49cf tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [56afe969-a03b-4324-81cd-d737d481e3df] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 55098. Aug 24 06:01:32.477627 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9bed3caa-1e4a-4f02-9d46-5225ed4a49cf tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.326893 Aug 24 06:01:32.478908 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 623/1292] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 24 06:01:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:01:32.659530 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7ca2fb4e-e6d9-4459-8cf9-0e600d008358 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:32.660230 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7ca2fb4e-e6d9-4459-8cf9-0e600d008358 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:32.675736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ca2fb4e-e6d9-4459-8cf9-0e600d008358 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:32.676680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ca2fb4e-e6d9-4459-8cf9-0e600d008358 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:32.677736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ca2fb4e-e6d9-4459-8cf9-0e600d008358 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:32.679652 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ca2fb4e-e6d9-4459-8cf9-0e600d008358 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:32.689386 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ca2fb4e-e6d9-4459-8cf9-0e600d008358 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:32.689386 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7ca2fb4e-e6d9-4459-8cf9-0e600d008358 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:32.830344 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7ca2fb4e-e6d9-4459-8cf9-0e600d008358 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:32.840858 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-73efe854-d50d-4d1e-9d63-d263f2e1a8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:32.855537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7ca2fb4e-e6d9-4459-8cf9-0e600d008358 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1674 microversion: 2.1 time: 0.185623 Aug 24 06:01:32.855822 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-73efe854-d50d-4d1e-9d63-d263f2e1a8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:32.856004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 670/1293] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:32 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:32.864849 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73efe854-d50d-4d1e-9d63-d263f2e1a8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:32.865341 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73efe854-d50d-4d1e-9d63-d263f2e1a8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:32.865821 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73efe854-d50d-4d1e-9d63-d263f2e1a8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:32.866837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73efe854-d50d-4d1e-9d63-d263f2e1a8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:32.867295 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73efe854-d50d-4d1e-9d63-d263f2e1a8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:32.867721 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-73efe854-d50d-4d1e-9d63-d263f2e1a8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:33.012933 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-73efe854-d50d-4d1e-9d63-d263f2e1a8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:33.020908 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-73efe854-d50d-4d1e-9d63-d263f2e1a8c2 tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1513 microversion: 2.1 time: 0.186187 Aug 24 06:01:33.021478 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 624/1294] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:32 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:33.247097 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-762bb8b8-0ead-4635-ac9c-59edfd35c9a8 req-55d93ebe-66f0-4d72-82a7-eb67399afbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a10b0c1-3cc4-4b01-9505-f1280f4d5823", "name": "network-vif-deleted", "tag": "9fdaaddd-48e7-476f-b235-b28339c385d9"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:01:33.257106 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-762bb8b8-0ead-4635-ac9c-59edfd35c9a8 req-55d93ebe-66f0-4d72-82a7-eb67399afbb8 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:33.257598 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-762bb8b8-0ead-4635-ac9c-59edfd35c9a8 req-55d93ebe-66f0-4d72-82a7-eb67399afbb8 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:33.258221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-762bb8b8-0ead-4635-ac9c-59edfd35c9a8 req-55d93ebe-66f0-4d72-82a7-eb67399afbb8 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:33.270959 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-762bb8b8-0ead-4635-ac9c-59edfd35c9a8 req-55d93ebe-66f0-4d72-82a7-eb67399afbb8 service nova] Creating event network-vif-deleted:9fdaaddd-48e7-476f-b235-b28339c385d9 for instance 7a10b0c1-3cc4-4b01-9505-f1280f4d5823 on hv-cinder-85426 Aug 24 06:01:33.277180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-762bb8b8-0ead-4635-ac9c-59edfd35c9a8 req-55d93ebe-66f0-4d72-82a7-eb67399afbb8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097694 Aug 24 06:01:33.277757 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 671/1295] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:01:33.863150 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-cf49a390-ef52-4eda-b195-bb78434798ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:33.863766 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-cf49a390-ef52-4eda-b195-bb78434798ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:33.870881 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cf49a390-ef52-4eda-b195-bb78434798ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:33.872535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cf49a390-ef52-4eda-b195-bb78434798ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:33.881095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cf49a390-ef52-4eda-b195-bb78434798ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:33.881095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cf49a390-ef52-4eda-b195-bb78434798ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:33.881095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cf49a390-ef52-4eda-b195-bb78434798ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:33.881095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cf49a390-ef52-4eda-b195-bb78434798ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:33.954046 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-cf49a390-ef52-4eda-b195-bb78434798ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:33.964419 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-cf49a390-ef52-4eda-b195-bb78434798ea tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1606 microversion: 2.1 time: 0.105208 Aug 24 06:01:33.973114 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 625/1296] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:33 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1606 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:34.045605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:34.046318 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:34.055743 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:34.058379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:34.058379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:34.067152 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:34.067893 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:34.068573 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:34.114969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:34.115861 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:34.116567 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:34.116667 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lazy-loading 'fault' on Instance uuid 7a10b0c1-3cc4-4b01-9505-f1280f4d5823 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:01:34.138915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-a3321672-d2ce-4e69-bf3c-d835799edb9c req-1a451c6e-1efc-411a-aa7b-be9daee4077e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21cccbf8-b418-4977-900d-f4b1fa91d277", "name": "network-vif-deleted", "tag": "2367aab4-1a36-48c8-bbf9-71894aaea93e"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:01:34.154895 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-a3321672-d2ce-4e69-bf3c-d835799edb9c req-1a451c6e-1efc-411a-aa7b-be9daee4077e service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:34.155594 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-a3321672-d2ce-4e69-bf3c-d835799edb9c req-1a451c6e-1efc-411a-aa7b-be9daee4077e service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:34.156456 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-a3321672-d2ce-4e69-bf3c-d835799edb9c req-1a451c6e-1efc-411a-aa7b-be9daee4077e service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:34.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5395d46bf4d55bbce8e30198eab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6ba7a7881546eea41c15fa4c6e0244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:34.200680 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-a3321672-d2ce-4e69-bf3c-d835799edb9c req-1a451c6e-1efc-411a-aa7b-be9daee4077e service nova] Creating event network-vif-deleted:2367aab4-1a36-48c8-bbf9-71894aaea93e for instance 21cccbf8-b418-4977-900d-f4b1fa91d277 on hv-cinder-85426 Aug 24 06:01:34.210437 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-339c8921-02e4-4ac1-8850-6456b91eee7e tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 200 len: 1309 microversion: 2.1 time: 0.169443 Aug 24 06:01:34.211709 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 672/1297] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:34 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 1309 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:34.212906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-a3321672-d2ce-4e69-bf3c-d835799edb9c req-1a451c6e-1efc-411a-aa7b-be9daee4077e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077463 Aug 24 06:01:34.215494 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 626/1298] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:01:34.988665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:34.988665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:34.995541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:34.996036 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:34.997442 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:35.001830 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:35.002483 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:35.003090 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:35.044021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:35.044850 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:35.045218 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:35.045660 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lazy-loading 'fault' on Instance uuid 21cccbf8-b418-4977-900d-f4b1fa91d277 {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:01:35.114109 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:35.127428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8f297cb3-f942-479d-8e29-5f6e1c98821c tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 200 len: 1328 microversion: 2.1 time: 0.143572 Aug 24 06:01:35.137856 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 673/1299] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:34 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 1328 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:35.236938 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:35.237611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] [instance: 7a10b0c1-3cc4-4b01-9505-f1280f4d5823] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:35.247315 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:35.247894 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:35.248388 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:35.249123 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:35.249579 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:35.250001 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:35.269742 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] HTTP exception thrown: Instance 7a10b0c1-3cc4-4b01-9505-f1280f4d5823 could not be found. Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Request method failure captured: Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 HTTP/1.1 Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBb4fpftLisGQURUVd9LoFu2phldXYJK6MuiK68tqfHuE9RoGmIUWHVjvpBO5d-XclMHOc0BooE71XS1hdiPaD4E8ODam-mF3uX1flaxKw6YFZj2Bs8P1mwJzwsQme4vYHE2Bw_e_SxxAF3IsFoDALw_mtsbE2fCkwoGezuT1J1Jz-xE Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: 4c6ba7a7881546eea41c15fa4c6e0244 Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-VolumesSnapshotTestJSON-979470569 Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 06:01:35.271356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4c6ba7a7881546eea41c15fa4c6e0244"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4c6ba7a7881546eea41c15fa4c6e0244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4c6ba7a7881546eea41c15fa4c6e0244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4c6ba7a7881546eea41c15fa4c6e0244"}]}] Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-VolumesSnapshotTestJSON-979470569 Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: 4c6ba7a7881546eea41c15fa4c6e0244 Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-979470569 Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-VolumesSnapshotTestJSON-979470569-project Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: 89b5395d46bf4d55bbce8e30198eab6d Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-VolumesSnapshotTestJSON-979470569-project Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 7a10b0c1-3cc4-4b01-9505-f1280f4d5823 could not be found. Aug 24 06:01:35.273951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '7a10b0c1-3cc4-4b01-9505-f1280f4d5823'} Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a10b0c1-3cc4-4b01-9505-f1280f4d5823 could not be found. Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:01:35.274847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a10b0c1-3cc4-4b01-9505-f1280f4d5823 could not be found. Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a10b0c1-3cc4-4b01-9505-f1280f4d5823 could not be found. Aug 24 06:01:35.276361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:01:35.278966 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] Returning 404 to user: Instance 7a10b0c1-3cc4-4b01-9505-f1280f4d5823 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:01:35.278966 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b76559b0-c3dc-45aa-b335-8f0cda01b21a tempest-VolumesSnapshotTestJSON-979470569 tempest-VolumesSnapshotTestJSON-979470569-project] 10.222.0.15 "GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823" status: 404 len: 111 microversion: 2.1 time: 0.045147 Aug 24 06:01:35.278966 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 627/1300] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:35 2022] GET /compute/v2.1/servers/7a10b0c1-3cc4-4b01-9505-f1280f4d5823 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:01:36.152388 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:36.153125 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:36.168034 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:36.172202 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:36.172700 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:36.173451 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:36.173925 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:36.174603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:36.204541 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] HTTP exception thrown: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Request method failure captured: Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 HTTP/1.1 Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbzpiLCaG6LtwRj4xLuY9qA1cQs4iXZwNvcXqrLACb82G9mFg5wabUqM0QjQR0S0Jg-SI9XOK4cw2SQyw8Ha7cbpgjz32nJCqye12YsWRCVnS70bYJH2NRFPnFbDSKLuJOB6q9S3dRQRbufpon65FtTTS3i4r7Ean7I7gDzmt3W1ZZ0 Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 06:01:36.207182 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}] Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 340c99a3e19343aab956056060a23896 Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:01:36.208784 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '21cccbf8-b418-4977-900d-f4b1fa91d277'} Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:01:36.210232 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:01:36.211680 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:01:36.213867 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Returning 404 to user: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:01:36.213867 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4f059785-b267-443c-a208-d117350c0a07 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 404 len: 111 microversion: 2.1 time: 0.061067 Aug 24 06:01:36.216229 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 674/1301] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:36 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:01:36.220937 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e29646eb-ebbe-4782-9c4f-5f69764b1dd1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '.version_select at 0x7f065ca65160>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:36.307736 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e29646eb-ebbe-4782-9c4f-5f69764b1dd1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064147333" status: 202 len: 0 microversion: 2.1 time: 0.090885 Aug 24 06:01:36.308366 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 628/1302] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 24 06:01:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064147333 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:01:37.170881 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-03e85642-474f-4c9e-9a2a-805f680ab6ab tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Action: 'create', calling method: .version_select at 0x7f06609a40d0>, body: {"keypair": {"name": "tempest-keypair-661726036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5kPMcidRHqb769bVB0amGKxKHTTWDF7RyL9FkGOU3F4dQSz4YL/nyqdX5M/qCTysjE1B/tvXd644KpAFczfwB++wU8ZkQxIUD4MqZZIEFXjOea6brfcipaGG33ZfqgEA=="}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:01:37.191033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-03e85642-474f-4c9e-9a2a-805f680ab6ab tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Getting quotas for project dd4a461b2a2645908c8229d77e13c743. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:01:37.195651 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-03e85642-474f-4c9e-9a2a-805f680ab6ab tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Getting quotas for user 340c99a3e19343aab956056060a23896 and project dd4a461b2a2645908c8229d77e13c743. Resources: {'key_pairs'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:01:37.283134 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-03e85642-474f-4c9e-9a2a-805f680ab6ab tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116750 Aug 24 06:01:37.283738 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 675/1303] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 24 06:01:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:01:39.898409 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1902144101", "imageRef": "6401c5b8-679e-46a6-82bc-1898eb3bb049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "890e4c7a-7a6f-4e14-8fdf-39631dd95515"}], "security_groups": [{"name": "tempest-securitygroup--1831758069"}], "key_name": "tempest-keypair-661726036", "user_data": "}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:01:40.004792 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.network.neutron [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] validate_networks() for [('890e4c7a-7a6f-4e14-8fdf-39631dd95515', None, None, None, None, None)] {{(pid=127755) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:01:40.650407 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Flavor limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:01:40.650931 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Image limits 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:01:40.651672 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Flavor pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:01:40.652219 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Image pref 0:0:0 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:01:40.653136 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.virt.hardware [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:01:40.666574 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:40.667269 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:40.667815 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:40.669117 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:40.669761 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:40.670444 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:40.692716 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Getting quotas for project dd4a461b2a2645908c8229d77e13c743. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:01:40.698590 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.quota [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Getting quotas for user 340c99a3e19343aab956056060a23896 and project dd4a461b2a2645908c8229d77e13c743. Resources: {'ram', 'instances', 'cores'} {{(pid=127755) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:01:40.715529 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Going to run 1 instances... {{(pid=127755) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:01:40.717907 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6401c5b8-679e-46a6-82bc-1898eb3bb049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:01:40.964488 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7b11fe00-7fe0-4599-b3b9-a1db8eeea48b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.071435 Aug 24 06:01:40.965899 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 629/1304] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 06:01:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:01:40.976414 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c7a94067-ec64-4458-9369-6f6985f3dcf6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:40.977561 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c7a94067-ec64-4458-9369-6f6985f3dcf6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:41.033328 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c7a94067-ec64-4458-9369-6f6985f3dcf6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:41.042017 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c7a94067-ec64-4458-9369-6f6985f3dcf6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1237 microversion: 2.1 time: 0.069979 Aug 24 06:01:41.042584 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 676/1305] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:40 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:42.065781 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6f57521a-100b-4343-a70d-910b94174199 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:42.066431 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6f57521a-100b-4343-a70d-910b94174199 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:42.072863 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6f57521a-100b-4343-a70d-910b94174199 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:42.073356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6f57521a-100b-4343-a70d-910b94174199 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:42.073911 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6f57521a-100b-4343-a70d-910b94174199 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:42.074649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6f57521a-100b-4343-a70d-910b94174199 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:42.075114 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6f57521a-100b-4343-a70d-910b94174199 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:42.075546 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6f57521a-100b-4343-a70d-910b94174199 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:42.138668 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6f57521a-100b-4343-a70d-910b94174199 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:42.146555 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6f57521a-100b-4343-a70d-910b94174199 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1241 microversion: 2.1 time: 0.085197 Aug 24 06:01:42.147060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 630/1306] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:42 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:43.167722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-1c8f4958-893d-47c0-b5a0-6fa83996e9d6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:43.168330 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-1c8f4958-893d-47c0-b5a0-6fa83996e9d6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:43.174922 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c8f4958-893d-47c0-b5a0-6fa83996e9d6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:43.175393 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c8f4958-893d-47c0-b5a0-6fa83996e9d6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:43.175853 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c8f4958-893d-47c0-b5a0-6fa83996e9d6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:43.176559 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c8f4958-893d-47c0-b5a0-6fa83996e9d6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:43.177010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c8f4958-893d-47c0-b5a0-6fa83996e9d6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:43.177683 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-1c8f4958-893d-47c0-b5a0-6fa83996e9d6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:43.239562 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-1c8f4958-893d-47c0-b5a0-6fa83996e9d6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:43.248076 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-1c8f4958-893d-47c0-b5a0-6fa83996e9d6 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1241 microversion: 2.1 time: 0.084899 Aug 24 06:01:43.248676 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 677/1307] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:43 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:44.268888 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3516f4f6-4e95-41a8-864a-e8fe981ecef1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:44.269510 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3516f4f6-4e95-41a8-864a-e8fe981ecef1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:44.276266 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3516f4f6-4e95-41a8-864a-e8fe981ecef1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:44.276786 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3516f4f6-4e95-41a8-864a-e8fe981ecef1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:44.277231 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3516f4f6-4e95-41a8-864a-e8fe981ecef1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:44.277927 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3516f4f6-4e95-41a8-864a-e8fe981ecef1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:44.278389 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3516f4f6-4e95-41a8-864a-e8fe981ecef1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:44.278906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3516f4f6-4e95-41a8-864a-e8fe981ecef1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:44.343739 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3516f4f6-4e95-41a8-864a-e8fe981ecef1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:44.352000 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3516f4f6-4e95-41a8-864a-e8fe981ecef1 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1241 microversion: 2.1 time: 0.086977 Aug 24 06:01:44.353149 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 631/1308] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:44 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:45.375781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5e11fcbb-1456-4bc1-9c6c-40f52fd62ee7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:45.376463 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5e11fcbb-1456-4bc1-9c6c-40f52fd62ee7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:45.384286 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5e11fcbb-1456-4bc1-9c6c-40f52fd62ee7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:45.390910 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5e11fcbb-1456-4bc1-9c6c-40f52fd62ee7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:45.390910 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5e11fcbb-1456-4bc1-9c6c-40f52fd62ee7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:45.390910 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5e11fcbb-1456-4bc1-9c6c-40f52fd62ee7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:45.390910 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5e11fcbb-1456-4bc1-9c6c-40f52fd62ee7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:45.391345 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5e11fcbb-1456-4bc1-9c6c-40f52fd62ee7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:45.491506 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5e11fcbb-1456-4bc1-9c6c-40f52fd62ee7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:45.522910 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5e11fcbb-1456-4bc1-9c6c-40f52fd62ee7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1297 microversion: 2.1 time: 0.150847 Aug 24 06:01:45.523497 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 678/1309] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:45 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1297 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:46.548138 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9934bbe3-ec49-4228-a634-debdbbab82c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:46.548961 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9934bbe3-ec49-4228-a634-debdbbab82c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:46.556498 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9934bbe3-ec49-4228-a634-debdbbab82c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:46.556991 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9934bbe3-ec49-4228-a634-debdbbab82c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:46.557433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9934bbe3-ec49-4228-a634-debdbbab82c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:46.558141 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9934bbe3-ec49-4228-a634-debdbbab82c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:46.558603 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9934bbe3-ec49-4228-a634-debdbbab82c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:46.559150 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9934bbe3-ec49-4228-a634-debdbbab82c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:46.807917 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9934bbe3-ec49-4228-a634-debdbbab82c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:46.816555 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9934bbe3-ec49-4228-a634-debdbbab82c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.272231 Aug 24 06:01:46.817144 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 632/1310] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:46 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:47.402391 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-12f64add-2d09-4393-8180-edd243a02426 req-5ddb1d63-7455-471c-a1be-3cc154fc5b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886fca83-d514-4f93-b32f-1266cd2f7dde", "tag": "beedb010-bdab-47bb-9bec-963fffe3b3d1"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:01:47.413361 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-12f64add-2d09-4393-8180-edd243a02426 req-5ddb1d63-7455-471c-a1be-3cc154fc5b6e service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:47.413837 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-12f64add-2d09-4393-8180-edd243a02426 req-5ddb1d63-7455-471c-a1be-3cc154fc5b6e service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:47.414270 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-12f64add-2d09-4393-8180-edd243a02426 req-5ddb1d63-7455-471c-a1be-3cc154fc5b6e service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:47.426464 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-12f64add-2d09-4393-8180-edd243a02426 req-5ddb1d63-7455-471c-a1be-3cc154fc5b6e service nova] Creating event network-changed:beedb010-bdab-47bb-9bec-963fffe3b3d1 for instance 886fca83-d514-4f93-b32f-1266cd2f7dde on hv-cinder-85426 Aug 24 06:01:47.432471 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-12f64add-2d09-4393-8180-edd243a02426 req-5ddb1d63-7455-471c-a1be-3cc154fc5b6e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033989 Aug 24 06:01:47.433044 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 679/1311] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:01:47.838414 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-57dbd4d9-ddde-4970-b958-f7ca85464b54 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:47.839032 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-57dbd4d9-ddde-4970-b958-f7ca85464b54 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:47.845977 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57dbd4d9-ddde-4970-b958-f7ca85464b54 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:47.846472 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57dbd4d9-ddde-4970-b958-f7ca85464b54 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:47.846912 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57dbd4d9-ddde-4970-b958-f7ca85464b54 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:47.847647 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57dbd4d9-ddde-4970-b958-f7ca85464b54 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:47.848250 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57dbd4d9-ddde-4970-b958-f7ca85464b54 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:47.848661 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-57dbd4d9-ddde-4970-b958-f7ca85464b54 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:48.003614 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-57dbd4d9-ddde-4970-b958-f7ca85464b54 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:48.012037 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-57dbd4d9-ddde-4970-b958-f7ca85464b54 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.177994 Aug 24 06:01:48.012641 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 633/1312] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:47 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:49.034326 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-cea36149-3fa1-47f9-8e02-12ba2e47402a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:49.034950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-cea36149-3fa1-47f9-8e02-12ba2e47402a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:49.041848 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cea36149-3fa1-47f9-8e02-12ba2e47402a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:49.042334 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cea36149-3fa1-47f9-8e02-12ba2e47402a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:49.042776 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cea36149-3fa1-47f9-8e02-12ba2e47402a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:49.043471 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cea36149-3fa1-47f9-8e02-12ba2e47402a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:49.043929 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cea36149-3fa1-47f9-8e02-12ba2e47402a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:49.044356 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cea36149-3fa1-47f9-8e02-12ba2e47402a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:49.182318 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cea36149-3fa1-47f9-8e02-12ba2e47402a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:49.190145 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-cea36149-3fa1-47f9-8e02-12ba2e47402a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.160688 Aug 24 06:01:49.190707 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 680/1313] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:49 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:50.211176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-c2484e87-f794-42d8-ab10-824835721afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:50.213025 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-c2484e87-f794-42d8-ab10-824835721afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:50.219642 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c2484e87-f794-42d8-ab10-824835721afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:50.228649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c2484e87-f794-42d8-ab10-824835721afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:50.228649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c2484e87-f794-42d8-ab10-824835721afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:50.228649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c2484e87-f794-42d8-ab10-824835721afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:50.228649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c2484e87-f794-42d8-ab10-824835721afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:50.229285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-c2484e87-f794-42d8-ab10-824835721afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:50.360358 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-c2484e87-f794-42d8-ab10-824835721afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:50.368498 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-c2484e87-f794-42d8-ab10-824835721afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.160729 Aug 24 06:01:50.369060 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 634/1314] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:50 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:51.390838 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-f83c7949-d223-4521-ac79-b17622d64c9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:51.391431 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-f83c7949-d223-4521-ac79-b17622d64c9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:51.393844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=6 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:51.398530 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f83c7949-d223-4521-ac79-b17622d64c9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:51.399143 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f83c7949-d223-4521-ac79-b17622d64c9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:51.400135 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f83c7949-d223-4521-ac79-b17622d64c9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:51.400926 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f83c7949-d223-4521-ac79-b17622d64c9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:51.401383 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f83c7949-d223-4521-ac79-b17622d64c9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:51.401805 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-f83c7949-d223-4521-ac79-b17622d64c9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:51.531371 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-f83c7949-d223-4521-ac79-b17622d64c9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:51.538983 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-f83c7949-d223-4521-ac79-b17622d64c9f tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.152169 Aug 24 06:01:51.539548 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 681/1315] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:51 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:52.560646 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-5bd1cc84-2428-4b79-bbd7-24ed678156a4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:52.561211 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-5bd1cc84-2428-4b79-bbd7-24ed678156a4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:52.563247 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:52.563899 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=10 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:52.569502 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bd1cc84-2428-4b79-bbd7-24ed678156a4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:52.569984 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bd1cc84-2428-4b79-bbd7-24ed678156a4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:52.570462 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bd1cc84-2428-4b79-bbd7-24ed678156a4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:52.571963 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bd1cc84-2428-4b79-bbd7-24ed678156a4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:52.572460 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bd1cc84-2428-4b79-bbd7-24ed678156a4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:52.572887 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-5bd1cc84-2428-4b79-bbd7-24ed678156a4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:52.705602 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-5bd1cc84-2428-4b79-bbd7-24ed678156a4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:52.713249 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-5bd1cc84-2428-4b79-bbd7-24ed678156a4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.156537 Aug 24 06:01:52.713810 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 635/1316] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:52 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:53.734519 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-d8f79b6e-4b93-41b6-9795-eb4eaec23f85 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:53.735130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-d8f79b6e-4b93-41b6-9795-eb4eaec23f85 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:53.741797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f79b6e-4b93-41b6-9795-eb4eaec23f85 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:53.742272 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f79b6e-4b93-41b6-9795-eb4eaec23f85 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:53.742728 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f79b6e-4b93-41b6-9795-eb4eaec23f85 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:53.743410 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f79b6e-4b93-41b6-9795-eb4eaec23f85 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:53.744609 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f79b6e-4b93-41b6-9795-eb4eaec23f85 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:53.745058 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-d8f79b6e-4b93-41b6-9795-eb4eaec23f85 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:53.762785 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:53.873985 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-d8f79b6e-4b93-41b6-9795-eb4eaec23f85 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:53.881434 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-d8f79b6e-4b93-41b6-9795-eb4eaec23f85 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.151267 Aug 24 06:01:53.881985 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 682/1317] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:53 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:54.901810 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8e7abd99-8d5a-4eb1-bda2-844e74fd0d6a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:54.902551 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8e7abd99-8d5a-4eb1-bda2-844e74fd0d6a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:54.908954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e7abd99-8d5a-4eb1-bda2-844e74fd0d6a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:54.909437 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e7abd99-8d5a-4eb1-bda2-844e74fd0d6a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:54.909873 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e7abd99-8d5a-4eb1-bda2-844e74fd0d6a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:54.910567 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e7abd99-8d5a-4eb1-bda2-844e74fd0d6a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:54.911022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e7abd99-8d5a-4eb1-bda2-844e74fd0d6a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:54.911480 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8e7abd99-8d5a-4eb1-bda2-844e74fd0d6a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:55.043250 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8e7abd99-8d5a-4eb1-bda2-844e74fd0d6a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:55.050649 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8e7abd99-8d5a-4eb1-bda2-844e74fd0d6a tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.152800 Aug 24 06:01:55.051217 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 636/1318] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:54 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:56.071782 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c745212c-eba7-4774-b343-dcad11bc8652 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:56.072408 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c745212c-eba7-4774-b343-dcad11bc8652 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:56.079301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c745212c-eba7-4774-b343-dcad11bc8652 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:56.079783 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c745212c-eba7-4774-b343-dcad11bc8652 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:56.080222 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c745212c-eba7-4774-b343-dcad11bc8652 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:56.080963 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c745212c-eba7-4774-b343-dcad11bc8652 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:56.081405 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c745212c-eba7-4774-b343-dcad11bc8652 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:56.081833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c745212c-eba7-4774-b343-dcad11bc8652 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:56.220039 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-c745212c-eba7-4774-b343-dcad11bc8652 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:56.227616 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c745212c-eba7-4774-b343-dcad11bc8652 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.159759 Aug 24 06:01:56.228172 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 683/1319] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:56 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:57.249277 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-92dc94f1-506b-41c4-a371-04076c24dad7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:57.249928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-92dc94f1-506b-41c4-a371-04076c24dad7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:57.256288 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92dc94f1-506b-41c4-a371-04076c24dad7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:57.256798 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92dc94f1-506b-41c4-a371-04076c24dad7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:57.257236 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92dc94f1-506b-41c4-a371-04076c24dad7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:57.257925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92dc94f1-506b-41c4-a371-04076c24dad7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:57.258378 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92dc94f1-506b-41c4-a371-04076c24dad7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:57.258804 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-92dc94f1-506b-41c4-a371-04076c24dad7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:57.386356 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-92dc94f1-506b-41c4-a371-04076c24dad7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:57.394098 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-92dc94f1-506b-41c4-a371-04076c24dad7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.149347 Aug 24 06:01:57.394653 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 637/1320] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:57 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:58.415448 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-803ba612-bb5b-4d96-9449-6f37f55cabfb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:58.416205 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-803ba612-bb5b-4d96-9449-6f37f55cabfb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:58.418573 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:58.424883 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-803ba612-bb5b-4d96-9449-6f37f55cabfb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:58.427972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-803ba612-bb5b-4d96-9449-6f37f55cabfb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:58.427972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-803ba612-bb5b-4d96-9449-6f37f55cabfb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:58.427972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-803ba612-bb5b-4d96-9449-6f37f55cabfb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:58.427972 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-803ba612-bb5b-4d96-9449-6f37f55cabfb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:58.428375 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-803ba612-bb5b-4d96-9449-6f37f55cabfb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:58.566707 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-803ba612-bb5b-4d96-9449-6f37f55cabfb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:58.575594 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-803ba612-bb5b-4d96-9449-6f37f55cabfb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.164111 Aug 24 06:01:58.576799 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 684/1321] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:58 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:59.597483 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-98abb281-ee4d-438a-a3c9-adda39e0cb75 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:59.598121 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-98abb281-ee4d-438a-a3c9-adda39e0cb75 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:59.604563 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98abb281-ee4d-438a-a3c9-adda39e0cb75 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:59.605051 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98abb281-ee4d-438a-a3c9-adda39e0cb75 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:59.605487 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98abb281-ee4d-438a-a3c9-adda39e0cb75 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:59.606178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98abb281-ee4d-438a-a3c9-adda39e0cb75 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:59.606635 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98abb281-ee4d-438a-a3c9-adda39e0cb75 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:59.607062 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-98abb281-ee4d-438a-a3c9-adda39e0cb75 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:59.738303 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-98abb281-ee4d-438a-a3c9-adda39e0cb75 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:59.742098 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:59.747094 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-98abb281-ee4d-438a-a3c9-adda39e0cb75 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.153446 Aug 24 06:01:59.747864 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 638/1322] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:59 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:59.889210 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-7e0be130-975b-4558-bef7-bee0bd2a696f req-1bf504e6-ac29-4052-85d3-69591286d70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886fca83-d514-4f93-b32f-1266cd2f7dde", "name": "network-vif-plugged", "status": "completed", "tag": "beedb010-bdab-47bb-9bec-963fffe3b3d1"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:01:59.899568 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-7e0be130-975b-4558-bef7-bee0bd2a696f req-1bf504e6-ac29-4052-85d3-69591286d70b service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:59.900021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-7e0be130-975b-4558-bef7-bee0bd2a696f req-1bf504e6-ac29-4052-85d3-69591286d70b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:59.900470 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-7e0be130-975b-4558-bef7-bee0bd2a696f req-1bf504e6-ac29-4052-85d3-69591286d70b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:59.911816 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-7e0be130-975b-4558-bef7-bee0bd2a696f req-1bf504e6-ac29-4052-85d3-69591286d70b service nova] Creating event network-vif-plugged:beedb010-bdab-47bb-9bec-963fffe3b3d1 for instance 886fca83-d514-4f93-b32f-1266cd2f7dde on hv-cinder-85426 Aug 24 06:01:59.916842 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-7e0be130-975b-4558-bef7-bee0bd2a696f req-1bf504e6-ac29-4052-85d3-69591286d70b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032147 Aug 24 06:01:59.917459 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 685/1323] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:02:00.774841 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f00dfe9a-647f-4d1f-afed-039e45d68a7d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:00.775444 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f00dfe9a-647f-4d1f-afed-039e45d68a7d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:00.778175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:02:00.783659 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f00dfe9a-647f-4d1f-afed-039e45d68a7d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:00.784155 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f00dfe9a-647f-4d1f-afed-039e45d68a7d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:00.784631 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f00dfe9a-647f-4d1f-afed-039e45d68a7d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:00.785609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f00dfe9a-647f-4d1f-afed-039e45d68a7d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:00.786192 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f00dfe9a-647f-4d1f-afed-039e45d68a7d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:00.786625 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f00dfe9a-647f-4d1f-afed-039e45d68a7d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:00.922295 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f00dfe9a-647f-4d1f-afed-039e45d68a7d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:00.930122 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f00dfe9a-647f-4d1f-afed-039e45d68a7d tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.159175 Aug 24 06:02:00.930686 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 639/1324] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:00 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:01.953184 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-78335e93-7e07-4486-8cf8-a84829dbd0c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:01.953892 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-78335e93-7e07-4486-8cf8-a84829dbd0c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:01.960109 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78335e93-7e07-4486-8cf8-a84829dbd0c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:01.960635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78335e93-7e07-4486-8cf8-a84829dbd0c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:01.961093 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78335e93-7e07-4486-8cf8-a84829dbd0c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:01.961777 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78335e93-7e07-4486-8cf8-a84829dbd0c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:01.962233 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78335e93-7e07-4486-8cf8-a84829dbd0c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:01.962661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-78335e93-7e07-4486-8cf8-a84829dbd0c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:02.099969 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-78335e93-7e07-4486-8cf8-a84829dbd0c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:02.107769 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-78335e93-7e07-4486-8cf8-a84829dbd0c7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1363 microversion: 2.1 time: 0.160303 Aug 24 06:02:02.108328 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 686/1325] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:01 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:03.128451 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8c7d9a57-c6f3-4938-b3ca-d3a2d1fb2831 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:03.129070 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8c7d9a57-c6f3-4938-b3ca-d3a2d1fb2831 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:03.136737 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c7d9a57-c6f3-4938-b3ca-d3a2d1fb2831 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:03.137227 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c7d9a57-c6f3-4938-b3ca-d3a2d1fb2831 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:03.137671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c7d9a57-c6f3-4938-b3ca-d3a2d1fb2831 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:03.138369 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c7d9a57-c6f3-4938-b3ca-d3a2d1fb2831 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:03.138830 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c7d9a57-c6f3-4938-b3ca-d3a2d1fb2831 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:03.139258 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8c7d9a57-c6f3-4938-b3ca-d3a2d1fb2831 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:03.270880 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8c7d9a57-c6f3-4938-b3ca-d3a2d1fb2831 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:03.278520 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8c7d9a57-c6f3-4938-b3ca-d3a2d1fb2831 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1550 microversion: 2.1 time: 0.154765 Aug 24 06:02:03.279215 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 640/1326] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:03 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:03.299820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2bcdf362-3c28-48cf-85c1-5cc4747df965 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:03.300329 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2bcdf362-3c28-48cf-85c1-5cc4747df965 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:03.306872 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2bcdf362-3c28-48cf-85c1-5cc4747df965 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:03.307358 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2bcdf362-3c28-48cf-85c1-5cc4747df965 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:03.307801 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2bcdf362-3c28-48cf-85c1-5cc4747df965 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:03.308522 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2bcdf362-3c28-48cf-85c1-5cc4747df965 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:03.308984 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2bcdf362-3c28-48cf-85c1-5cc4747df965 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:03.309409 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2bcdf362-3c28-48cf-85c1-5cc4747df965 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:03.384994 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2bcdf362-3c28-48cf-85c1-5cc4747df965 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089495 Aug 24 06:02:03.385584 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 687/1327] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 24 06:02:03 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:02:04.399257 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-2623287d-9664-4f6c-9409-b63edcf3bb6b req-faf9c342-f611-487b-94f9-d793c2e6a50b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886fca83-d514-4f93-b32f-1266cd2f7dde", "tag": "beedb010-bdab-47bb-9bec-963fffe3b3d1"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:02:04.409596 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-2623287d-9664-4f6c-9409-b63edcf3bb6b req-faf9c342-f611-487b-94f9-d793c2e6a50b service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:04.410227 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-2623287d-9664-4f6c-9409-b63edcf3bb6b req-faf9c342-f611-487b-94f9-d793c2e6a50b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:04.410663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-2623287d-9664-4f6c-9409-b63edcf3bb6b req-faf9c342-f611-487b-94f9-d793c2e6a50b service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:04.422445 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-2623287d-9664-4f6c-9409-b63edcf3bb6b req-faf9c342-f611-487b-94f9-d793c2e6a50b service nova] Creating event network-changed:beedb010-bdab-47bb-9bec-963fffe3b3d1 for instance 886fca83-d514-4f93-b32f-1266cd2f7dde on hv-cinder-85426 Aug 24 06:02:04.428780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-2623287d-9664-4f6c-9409-b63edcf3bb6b req-faf9c342-f611-487b-94f9-d793c2e6a50b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031848 Aug 24 06:02:04.429369 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 641/1328] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:02:09.142127 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-775635930", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2090955796", "security_groups": [{"name": "tempest-secgroup-smoke-1257550603"}], "networks": [{"uuid": "85efe01d-d87a-466b-9f9d-b993b1f0d8fa"}], "block_device_mapping_v2": [{"uuid": "612b3d9c-4d0b-4252-a927-8815d33781d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:02:09.257592 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.network.neutron [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] validate_networks() for [('85efe01d-d87a-466b-9f9d-b993b1f0d8fa', None, None, None, None, None)] {{(pid=127756) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:02:09.893364 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Flavor limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:02:09.893781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Image limits 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:02:09.894244 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Flavor pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:02:09.894647 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Image pref 0:0:0 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:02:09.895053 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.virt.hardware [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:02:09.903800 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:09.904267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:09.904724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:09.905448 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:09.905885 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:09.906301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:09.923886 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Getting quotas for project 7373b9ca241b4fbba12f2413458072bb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:02:09.928147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.quota [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Getting quotas for user 3b4870c15b8149908b6c1a99b1f73bc0 and project 7373b9ca241b4fbba12f2413458072bb. Resources: {'ram', 'instances', 'cores'} {{(pid=127756) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:02:09.987922 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Going to run 1 instances... {{(pid=127756) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:02:09.990281 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='612b3d9c-4d0b-4252-a927-8815d33781d8',volume_size=None,volume_type=None)] {{(pid=127756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:02:10.467623 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-867267e2-1e75-4a16-873a-f0695f77c599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.330481 Aug 24 06:02:10.468601 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 688/1329] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 24 06:02:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:02:10.481316 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-71fd4514-8025-49d3-9f83-a4bc193465ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:10.482021 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-71fd4514-8025-49d3-9f83-a4bc193465ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:10.538303 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-71fd4514-8025-49d3-9f83-a4bc193465ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:10.545221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-71fd4514-8025-49d3-9f83-a4bc193465ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1088 microversion: 2.1 time: 0.068952 Aug 24 06:02:10.545789 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 642/1330] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:10 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:11.566292 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-796e40c9-d5c9-4a1b-8c13-1b7dd9792130 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:11.566902 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-796e40c9-d5c9-4a1b-8c13-1b7dd9792130 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:11.573597 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-796e40c9-d5c9-4a1b-8c13-1b7dd9792130 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:11.574086 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-796e40c9-d5c9-4a1b-8c13-1b7dd9792130 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:11.574527 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-796e40c9-d5c9-4a1b-8c13-1b7dd9792130 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:11.575275 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-796e40c9-d5c9-4a1b-8c13-1b7dd9792130 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:11.575734 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-796e40c9-d5c9-4a1b-8c13-1b7dd9792130 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:11.576164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-796e40c9-d5c9-4a1b-8c13-1b7dd9792130 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:11.648740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-796e40c9-d5c9-4a1b-8c13-1b7dd9792130 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:11.648740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-796e40c9-d5c9-4a1b-8c13-1b7dd9792130 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1138 microversion: 2.1 time: 0.085439 Aug 24 06:02:11.648740 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 689/1331] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:11 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:12.667422 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ab2806f7-0593-4442-8009-19d9b8afb61e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:12.668055 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ab2806f7-0593-4442-8009-19d9b8afb61e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:12.676227 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2806f7-0593-4442-8009-19d9b8afb61e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:12.676736 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2806f7-0593-4442-8009-19d9b8afb61e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:12.677166 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2806f7-0593-4442-8009-19d9b8afb61e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:12.678104 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2806f7-0593-4442-8009-19d9b8afb61e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:12.678628 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2806f7-0593-4442-8009-19d9b8afb61e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:12.679047 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ab2806f7-0593-4442-8009-19d9b8afb61e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:12.743875 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ab2806f7-0593-4442-8009-19d9b8afb61e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:12.753355 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ab2806f7-0593-4442-8009-19d9b8afb61e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1186 microversion: 2.1 time: 0.090022 Aug 24 06:02:12.753926 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 643/1332] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:12 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:13.776370 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-71bbf7c4-9930-4912-b3d8-18457775d73e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:13.776992 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-71bbf7c4-9930-4912-b3d8-18457775d73e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:13.785988 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71bbf7c4-9930-4912-b3d8-18457775d73e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:13.786487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71bbf7c4-9930-4912-b3d8-18457775d73e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:13.786931 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71bbf7c4-9930-4912-b3d8-18457775d73e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:13.787802 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71bbf7c4-9930-4912-b3d8-18457775d73e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:13.788093 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71bbf7c4-9930-4912-b3d8-18457775d73e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:13.788736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71bbf7c4-9930-4912-b3d8-18457775d73e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:13.962033 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-71bbf7c4-9930-4912-b3d8-18457775d73e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:13.970303 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-71bbf7c4-9930-4912-b3d8-18457775d73e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1272 microversion: 2.1 time: 0.198176 Aug 24 06:02:13.970871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 690/1333] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:13 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:02:14.803346 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-ec994e2d-561d-42ab-963f-f3f432d8fb29 req-02936bf9-336d-46e4-a625-a98088080158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dc7c37-52f8-435a-a1ed-e6636d1d8efe", "tag": "6051ada2-300c-4872-a793-dc5b851ffbfe"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:02:14.814022 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-ec994e2d-561d-42ab-963f-f3f432d8fb29 req-02936bf9-336d-46e4-a625-a98088080158 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:14.816050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-ec994e2d-561d-42ab-963f-f3f432d8fb29 req-02936bf9-336d-46e4-a625-a98088080158 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:14.816050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-ec994e2d-561d-42ab-963f-f3f432d8fb29 req-02936bf9-336d-46e4-a625-a98088080158 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:14.830535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-ec994e2d-561d-42ab-963f-f3f432d8fb29 req-02936bf9-336d-46e4-a625-a98088080158 service nova] Creating event network-changed:6051ada2-300c-4872-a793-dc5b851ffbfe for instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe on hv-cinder-85426 Aug 24 06:02:14.835630 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-ec994e2d-561d-42ab-963f-f3f432d8fb29 req-02936bf9-336d-46e4-a625-a98088080158 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037534 Aug 24 06:02:14.836261 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 644/1334] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:02:14.991824 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7162727f-01c6-4528-ad2c-df966b17162d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:14.993259 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7162727f-01c6-4528-ad2c-df966b17162d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:14.999586 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7162727f-01c6-4528-ad2c-df966b17162d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:15.002372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7162727f-01c6-4528-ad2c-df966b17162d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:15.002372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7162727f-01c6-4528-ad2c-df966b17162d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:15.002372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7162727f-01c6-4528-ad2c-df966b17162d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:15.002372 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7162727f-01c6-4528-ad2c-df966b17162d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:15.002844 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7162727f-01c6-4528-ad2c-df966b17162d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:15.202385 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-7162727f-01c6-4528-ad2c-df966b17162d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:15.210649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7162727f-01c6-4528-ad2c-df966b17162d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.222716 Aug 24 06:02:15.211221 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 691/1335] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:14 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:16.234611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-0607b87c-c7bb-4ac7-8a05-71d173371f3d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:16.235366 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-0607b87c-c7bb-4ac7-8a05-71d173371f3d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:16.241611 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0607b87c-c7bb-4ac7-8a05-71d173371f3d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:16.242095 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0607b87c-c7bb-4ac7-8a05-71d173371f3d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:16.242534 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0607b87c-c7bb-4ac7-8a05-71d173371f3d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:16.243221 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0607b87c-c7bb-4ac7-8a05-71d173371f3d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:16.243676 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0607b87c-c7bb-4ac7-8a05-71d173371f3d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:16.244103 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-0607b87c-c7bb-4ac7-8a05-71d173371f3d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:16.376706 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-0607b87c-c7bb-4ac7-8a05-71d173371f3d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:16.384299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-0607b87c-c7bb-4ac7-8a05-71d173371f3d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.154397 Aug 24 06:02:16.384889 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 645/1336] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:16 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:17.404908 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-8bddece3-a11d-4bcb-8b5a-4a3585253aa7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:17.405520 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-8bddece3-a11d-4bcb-8b5a-4a3585253aa7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:17.412360 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bddece3-a11d-4bcb-8b5a-4a3585253aa7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:17.412873 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bddece3-a11d-4bcb-8b5a-4a3585253aa7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:17.413314 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bddece3-a11d-4bcb-8b5a-4a3585253aa7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:17.413999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bddece3-a11d-4bcb-8b5a-4a3585253aa7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:17.414455 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bddece3-a11d-4bcb-8b5a-4a3585253aa7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:17.414875 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-8bddece3-a11d-4bcb-8b5a-4a3585253aa7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:17.545999 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-8bddece3-a11d-4bcb-8b5a-4a3585253aa7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:17.554627 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-8bddece3-a11d-4bcb-8b5a-4a3585253aa7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.153635 Aug 24 06:02:17.555189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 692/1337] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:17 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:18.575292 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-cd35d242-5511-4ac2-8487-15830527d09a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:18.575932 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-cd35d242-5511-4ac2-8487-15830527d09a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:18.586032 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cd35d242-5511-4ac2-8487-15830527d09a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:18.590009 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cd35d242-5511-4ac2-8487-15830527d09a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:18.590475 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cd35d242-5511-4ac2-8487-15830527d09a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:18.592256 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cd35d242-5511-4ac2-8487-15830527d09a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:18.592767 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cd35d242-5511-4ac2-8487-15830527d09a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:18.593205 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-cd35d242-5511-4ac2-8487-15830527d09a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:18.747796 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-cd35d242-5511-4ac2-8487-15830527d09a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:18.756925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-cd35d242-5511-4ac2-8487-15830527d09a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.185195 Aug 24 06:02:18.757810 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 646/1338] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:18 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:19.778702 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-021c8a0d-bd05-4833-819f-fbf6bdeea445 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:19.779306 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-021c8a0d-bd05-4833-819f-fbf6bdeea445 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:19.785810 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-021c8a0d-bd05-4833-819f-fbf6bdeea445 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:19.786282 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-021c8a0d-bd05-4833-819f-fbf6bdeea445 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:19.786711 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-021c8a0d-bd05-4833-819f-fbf6bdeea445 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:19.787421 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-021c8a0d-bd05-4833-819f-fbf6bdeea445 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:19.787871 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-021c8a0d-bd05-4833-819f-fbf6bdeea445 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:19.788286 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-021c8a0d-bd05-4833-819f-fbf6bdeea445 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:19.914597 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:02:19.921570 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-021c8a0d-bd05-4833-819f-fbf6bdeea445 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:19.929670 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-021c8a0d-bd05-4833-819f-fbf6bdeea445 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.154897 Aug 24 06:02:19.930235 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 693/1339] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:19 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:20.950674 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-af4d713a-3f37-4e03-a8b9-b5c006419352 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:20.951323 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-af4d713a-3f37-4e03-a8b9-b5c006419352 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:20.955055 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell0:SELECT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:02:20.959191 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af4d713a-3f37-4e03-a8b9-b5c006419352 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:20.959684 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af4d713a-3f37-4e03-a8b9-b5c006419352 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:20.960135 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af4d713a-3f37-4e03-a8b9-b5c006419352 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:20.960866 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af4d713a-3f37-4e03-a8b9-b5c006419352 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:20.961339 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af4d713a-3f37-4e03-a8b9-b5c006419352 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:20.961768 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-af4d713a-3f37-4e03-a8b9-b5c006419352 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:21.093291 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-af4d713a-3f37-4e03-a8b9-b5c006419352 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:21.101175 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-af4d713a-3f37-4e03-a8b9-b5c006419352 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.154359 Aug 24 06:02:21.101746 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 647/1340] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:20 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:22.121891 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a2484699-479f-41b3-94dd-ca5037641e5f tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:22.122494 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a2484699-479f-41b3-94dd-ca5037641e5f tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:22.124640 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell0:SELECT=6 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:02:22.129923 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2484699-479f-41b3-94dd-ca5037641e5f tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:22.130403 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2484699-479f-41b3-94dd-ca5037641e5f tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:22.130834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2484699-479f-41b3-94dd-ca5037641e5f tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:22.131510 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2484699-479f-41b3-94dd-ca5037641e5f tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:22.131982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2484699-479f-41b3-94dd-ca5037641e5f tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:22.132377 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a2484699-479f-41b3-94dd-ca5037641e5f tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:22.267474 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a2484699-479f-41b3-94dd-ca5037641e5f tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:22.275798 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a2484699-479f-41b3-94dd-ca5037641e5f tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.157790 Aug 24 06:02:22.276357 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 694/1341] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:22 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:23.297642 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-df329c66-2158-4bef-8c69-3ca8438c5a86 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:23.298192 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-df329c66-2158-4bef-8c69-3ca8438c5a86 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:23.305400 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-df329c66-2158-4bef-8c69-3ca8438c5a86 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:23.305886 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-df329c66-2158-4bef-8c69-3ca8438c5a86 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:23.306326 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-df329c66-2158-4bef-8c69-3ca8438c5a86 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:23.307018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-df329c66-2158-4bef-8c69-3ca8438c5a86 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:23.307475 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-df329c66-2158-4bef-8c69-3ca8438c5a86 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:23.307904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-df329c66-2158-4bef-8c69-3ca8438c5a86 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:23.438030 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-df329c66-2158-4bef-8c69-3ca8438c5a86 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:23.446209 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-df329c66-2158-4bef-8c69-3ca8438c5a86 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.152969 Aug 24 06:02:23.446767 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 648/1342] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:23 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:24.467265 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-966300eb-3c83-4096-a38b-89916fa58ee4 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:24.467882 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-966300eb-3c83-4096-a38b-89916fa58ee4 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:24.474696 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-966300eb-3c83-4096-a38b-89916fa58ee4 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:24.475978 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-966300eb-3c83-4096-a38b-89916fa58ee4 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:24.476702 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-966300eb-3c83-4096-a38b-89916fa58ee4 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:24.477409 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-966300eb-3c83-4096-a38b-89916fa58ee4 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:24.477867 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-966300eb-3c83-4096-a38b-89916fa58ee4 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:24.478340 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-966300eb-3c83-4096-a38b-89916fa58ee4 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:24.482421 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=65 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:02:24.613403 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-966300eb-3c83-4096-a38b-89916fa58ee4 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:24.621030 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-966300eb-3c83-4096-a38b-89916fa58ee4 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.157818 Aug 24 06:02:24.621595 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 695/1343] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:24 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:25.642178 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-24600b79-9c2e-4c5e-9fc9-050bf439f5d2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:25.642814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-24600b79-9c2e-4c5e-9fc9-050bf439f5d2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:25.649814 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24600b79-9c2e-4c5e-9fc9-050bf439f5d2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:25.650289 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24600b79-9c2e-4c5e-9fc9-050bf439f5d2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:25.650717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24600b79-9c2e-4c5e-9fc9-050bf439f5d2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:25.651396 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24600b79-9c2e-4c5e-9fc9-050bf439f5d2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:25.651845 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24600b79-9c2e-4c5e-9fc9-050bf439f5d2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:25.652266 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-24600b79-9c2e-4c5e-9fc9-050bf439f5d2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:25.785446 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-24600b79-9c2e-4c5e-9fc9-050bf439f5d2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:25.794155 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-24600b79-9c2e-4c5e-9fc9-050bf439f5d2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.155455 Aug 24 06:02:25.794726 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 649/1344] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:25 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:25.988381 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-a6e189eb-62bf-4b3d-96b4-a389f8d77495 req-d1ac9733-dbe0-4c54-9449-c5a48c6de3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dc7c37-52f8-435a-a1ed-e6636d1d8efe", "name": "network-vif-plugged", "status": "completed", "tag": "6051ada2-300c-4872-a793-dc5b851ffbfe"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:02:25.999005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-a6e189eb-62bf-4b3d-96b4-a389f8d77495 req-d1ac9733-dbe0-4c54-9449-c5a48c6de3f0 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:25.999482 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-a6e189eb-62bf-4b3d-96b4-a389f8d77495 req-d1ac9733-dbe0-4c54-9449-c5a48c6de3f0 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:25.999911 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-a6e189eb-62bf-4b3d-96b4-a389f8d77495 req-d1ac9733-dbe0-4c54-9449-c5a48c6de3f0 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:26.011254 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-a6e189eb-62bf-4b3d-96b4-a389f8d77495 req-d1ac9733-dbe0-4c54-9449-c5a48c6de3f0 service nova] Creating event network-vif-plugged:6051ada2-300c-4872-a793-dc5b851ffbfe for instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe on hv-cinder-85426 Aug 24 06:02:26.016512 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-a6e189eb-62bf-4b3d-96b4-a389f8d77495 req-d1ac9733-dbe0-4c54-9449-c5a48c6de3f0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031753 Aug 24 06:02:26.017010 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 696/1345] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:02:26.815739 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b238cd5a-62cf-411a-8261-276530b4c670 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:26.816310 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b238cd5a-62cf-411a-8261-276530b4c670 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:26.823747 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b238cd5a-62cf-411a-8261-276530b4c670 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:26.824224 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b238cd5a-62cf-411a-8261-276530b4c670 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:26.824688 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b238cd5a-62cf-411a-8261-276530b4c670 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:26.825372 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b238cd5a-62cf-411a-8261-276530b4c670 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:26.825823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b238cd5a-62cf-411a-8261-276530b4c670 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:26.826243 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b238cd5a-62cf-411a-8261-276530b4c670 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:26.960346 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b238cd5a-62cf-411a-8261-276530b4c670 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:26.967980 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b238cd5a-62cf-411a-8261-276530b4c670 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.156272 Aug 24 06:02:26.968593 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 650/1346] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:26 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:27.989930 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-58df3501-a83a-473d-8bbe-1e42635fb23a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:27.990635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-58df3501-a83a-473d-8bbe-1e42635fb23a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:27.997289 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58df3501-a83a-473d-8bbe-1e42635fb23a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:27.997776 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58df3501-a83a-473d-8bbe-1e42635fb23a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:27.998218 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58df3501-a83a-473d-8bbe-1e42635fb23a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:27.998911 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58df3501-a83a-473d-8bbe-1e42635fb23a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:27.999378 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58df3501-a83a-473d-8bbe-1e42635fb23a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:27.999809 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-58df3501-a83a-473d-8bbe-1e42635fb23a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:28.132833 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-58df3501-a83a-473d-8bbe-1e42635fb23a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:28.140700 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-58df3501-a83a-473d-8bbe-1e42635fb23a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1260 microversion: 2.1 time: 0.155457 Aug 24 06:02:28.141369 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 697/1347] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:27 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:29.161220 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6c8bd3c1-e679-44a0-a338-c6c7b0ab8bf5 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:29.161867 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6c8bd3c1-e679-44a0-a338-c6c7b0ab8bf5 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:29.168360 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c8bd3c1-e679-44a0-a338-c6c7b0ab8bf5 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:29.168877 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c8bd3c1-e679-44a0-a338-c6c7b0ab8bf5 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:29.169321 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c8bd3c1-e679-44a0-a338-c6c7b0ab8bf5 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:29.170015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c8bd3c1-e679-44a0-a338-c6c7b0ab8bf5 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:29.170476 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c8bd3c1-e679-44a0-a338-c6c7b0ab8bf5 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:29.170906 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6c8bd3c1-e679-44a0-a338-c6c7b0ab8bf5 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:29.303198 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6c8bd3c1-e679-44a0-a338-c6c7b0ab8bf5 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:29.311506 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6c8bd3c1-e679-44a0-a338-c6c7b0ab8bf5 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1442 microversion: 2.1 time: 0.154233 Aug 24 06:02:29.312074 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 651/1348] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:29 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:29.331255 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ce2219c6-a25f-47ef-b717-803cc5c8873e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:02:29.331906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ce2219c6-a25f-47ef-b717-803cc5c8873e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:02:29.338274 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce2219c6-a25f-47ef-b717-803cc5c8873e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:29.338754 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce2219c6-a25f-47ef-b717-803cc5c8873e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:29.339191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce2219c6-a25f-47ef-b717-803cc5c8873e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:29.339873 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce2219c6-a25f-47ef-b717-803cc5c8873e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:29.340326 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce2219c6-a25f-47ef-b717-803cc5c8873e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:29.340779 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ce2219c6-a25f-47ef-b717-803cc5c8873e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:29.476121 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ce2219c6-a25f-47ef-b717-803cc5c8873e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:02:29.483845 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ce2219c6-a25f-47ef-b717-803cc5c8873e tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1442 microversion: 2.1 time: 0.156354 Aug 24 06:02:29.484421 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 698/1349] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:02:29 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:02:31.597819 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-7bc293aa-45f0-4fbc-ba8f-9220c46c2447 req-54329131-a217-4f69-b5cb-61237ce065b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dc7c37-52f8-435a-a1ed-e6636d1d8efe", "tag": "6051ada2-300c-4872-a793-dc5b851ffbfe"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:02:31.607815 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-7bc293aa-45f0-4fbc-ba8f-9220c46c2447 req-54329131-a217-4f69-b5cb-61237ce065b5 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:02:31.608290 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-7bc293aa-45f0-4fbc-ba8f-9220c46c2447 req-54329131-a217-4f69-b5cb-61237ce065b5 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:02:31.608777 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-7bc293aa-45f0-4fbc-ba8f-9220c46c2447 req-54329131-a217-4f69-b5cb-61237ce065b5 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:02:31.620792 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-7bc293aa-45f0-4fbc-ba8f-9220c46c2447 req-54329131-a217-4f69-b5cb-61237ce065b5 service nova] Creating event network-changed:6051ada2-300c-4872-a793-dc5b851ffbfe for instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe on hv-cinder-85426 Aug 24 06:02:31.626051 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-7bc293aa-45f0-4fbc-ba8f-9220c46c2447 req-54329131-a217-4f69-b5cb-61237ce065b5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031896 Aug 24 06:02:31.627227 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 652/1350] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:03:33.992092 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:03:33.992888 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=19 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:03:33.996919 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a9e72a40-68f7-4116-a0b1-2c2f966faafc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:03:34.001509 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a9e72a40-68f7-4116-a0b1-2c2f966faafc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:03:34.003229 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9e72a40-68f7-4116-a0b1-2c2f966faafc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:34.003659 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9e72a40-68f7-4116-a0b1-2c2f966faafc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:34.004094 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9e72a40-68f7-4116-a0b1-2c2f966faafc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:34.004823 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9e72a40-68f7-4116-a0b1-2c2f966faafc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:34.005277 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9e72a40-68f7-4116-a0b1-2c2f966faafc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:34.005699 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a9e72a40-68f7-4116-a0b1-2c2f966faafc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:34.029743 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a9e72a40-68f7-4116-a0b1-2c2f966faafc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/ips" status: 200 len: 147 microversion: 2.1 time: 0.039460 Aug 24 06:03:34.030309 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 699/1351] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 24 06:03:33 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:03:36.768602 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=29 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:03:36.769340 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=66 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:03:36.773640 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-312dfe74-6033-42d8-9744-6d357fdfa326 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "586ef244-577f-4e04-a06e-2134ae88f847"}} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:03:36.776029 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-312dfe74-6033-42d8-9744-6d357fdfa326 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:03:36.782722 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-312dfe74-6033-42d8-9744-6d357fdfa326 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:36.787891 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-312dfe74-6033-42d8-9744-6d357fdfa326 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:36.787891 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-312dfe74-6033-42d8-9744-6d357fdfa326 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:36.787891 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-312dfe74-6033-42d8-9744-6d357fdfa326 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:36.787891 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-312dfe74-6033-42d8-9744-6d357fdfa326 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:36.788282 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-312dfe74-6033-42d8-9744-6d357fdfa326 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:37.854985 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-312dfe74-6033-42d8-9744-6d357fdfa326 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "POST /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.088019 Aug 24 06:03:37.855610 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 653/1352] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 06:03:36 2022] POST /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments => generated 194 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:03:46.632205 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c801e0-702d-4df4-8906-b6264cf908c3] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 06:03:46.637038 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b6d15dad-979e-48b7-8bef-a0e2dd1ba6a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:03:46.639227 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b6d15dad-979e-48b7-8bef-a0e2dd1ba6a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:03:46.646236 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6d15dad-979e-48b7-8bef-a0e2dd1ba6a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:46.651307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6d15dad-979e-48b7-8bef-a0e2dd1ba6a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:46.651307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6d15dad-979e-48b7-8bef-a0e2dd1ba6a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:46.651307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6d15dad-979e-48b7-8bef-a0e2dd1ba6a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:46.651307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6d15dad-979e-48b7-8bef-a0e2dd1ba6a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:46.651689 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b6d15dad-979e-48b7-8bef-a0e2dd1ba6a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:46.679939 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b6d15dad-979e-48b7-8bef-a0e2dd1ba6a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049654 Aug 24 06:03:46.685552 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 700/1353] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 06:03:46 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:03:46.692449 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-bf776c30-c92c-4790-8718-32ba0b7067a7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:03:46.693048 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-bf776c30-c92c-4790-8718-32ba0b7067a7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:03:46.700026 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bf776c30-c92c-4790-8718-32ba0b7067a7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:46.700536 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bf776c30-c92c-4790-8718-32ba0b7067a7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:46.700974 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bf776c30-c92c-4790-8718-32ba0b7067a7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:46.701905 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bf776c30-c92c-4790-8718-32ba0b7067a7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:46.702366 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bf776c30-c92c-4790-8718-32ba0b7067a7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:46.702827 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-bf776c30-c92c-4790-8718-32ba0b7067a7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:46.738034 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-bf776c30-c92c-4790-8718-32ba0b7067a7 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments/586ef244-577f-4e04-a06e-2134ae88f847" status: 200 len: 194 microversion: 2.1 time: 0.050480 Aug 24 06:03:46.738664 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 654/1354] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 24 06:03:46 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments/586ef244-577f-4e04-a06e-2134ae88f847 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:03:49.525073 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-71f7560c-976e-4e8a-9f53-e8ca98724cf8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "920d395b-d62a-408d-bdf2-f2305ac4a8c4"}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:03:49.527368 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-71f7560c-976e-4e8a-9f53-e8ca98724cf8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:03:49.535690 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71f7560c-976e-4e8a-9f53-e8ca98724cf8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:49.536173 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71f7560c-976e-4e8a-9f53-e8ca98724cf8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:49.536637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71f7560c-976e-4e8a-9f53-e8ca98724cf8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:49.537326 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71f7560c-976e-4e8a-9f53-e8ca98724cf8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:49.537780 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71f7560c-976e-4e8a-9f53-e8ca98724cf8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:49.538203 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-71f7560c-976e-4e8a-9f53-e8ca98724cf8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:49.543117 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c801e0-702d-4df4-8906-b6264cf908c3] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 55686. Aug 24 06:03:50.512724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-71f7560c-976e-4e8a-9f53-e8ca98724cf8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "POST /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991354 Aug 24 06:03:50.513368 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 701/1355] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 24 06:03:49 2022] POST /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:03:59.086717 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-13496ae1-6373-43e7-8ccc-9fe37f0f8e04 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:03:59.088997 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-13496ae1-6373-43e7-8ccc-9fe37f0f8e04 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:03:59.091632 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=4 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:03:59.092289 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:03:59.097806 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13496ae1-6373-43e7-8ccc-9fe37f0f8e04 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:59.104482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13496ae1-6373-43e7-8ccc-9fe37f0f8e04 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:59.104482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13496ae1-6373-43e7-8ccc-9fe37f0f8e04 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:59.104482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13496ae1-6373-43e7-8ccc-9fe37f0f8e04 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:59.104482 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13496ae1-6373-43e7-8ccc-9fe37f0f8e04 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:59.104901 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-13496ae1-6373-43e7-8ccc-9fe37f0f8e04 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:59.131779 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-13496ae1-6373-43e7-8ccc-9fe37f0f8e04 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049412 Aug 24 06:03:59.134823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 655/1356] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 06:03:59 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:03:59.278900 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-7931cbba-313a-465a-a9d4-1251b7117c48 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:03:59.279418 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-7931cbba-313a-465a-a9d4-1251b7117c48 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:03:59.286565 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7931cbba-313a-465a-a9d4-1251b7117c48 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:59.287044 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7931cbba-313a-465a-a9d4-1251b7117c48 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:59.287490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7931cbba-313a-465a-a9d4-1251b7117c48 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:59.288176 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7931cbba-313a-465a-a9d4-1251b7117c48 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:59.288653 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7931cbba-313a-465a-a9d4-1251b7117c48 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:59.289078 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-7931cbba-313a-465a-a9d4-1251b7117c48 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:59.318982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-7931cbba-313a-465a-a9d4-1251b7117c48 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments/586ef244-577f-4e04-a06e-2134ae88f847" status: 200 len: 194 microversion: 2.1 time: 0.045126 Aug 24 06:03:59.319563 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 702/1357] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 24 06:03:59 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments/586ef244-577f-4e04-a06e-2134ae88f847 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:03:59.330547 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-88b0e47f-91ad-4507-96ae-f4dfed9e0817 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:03:59.331039 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-88b0e47f-91ad-4507-96ae-f4dfed9e0817 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:03:59.337235 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88b0e47f-91ad-4507-96ae-f4dfed9e0817 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:59.337713 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88b0e47f-91ad-4507-96ae-f4dfed9e0817 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:59.338147 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88b0e47f-91ad-4507-96ae-f4dfed9e0817 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:59.338825 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88b0e47f-91ad-4507-96ae-f4dfed9e0817 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:03:59.339275 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88b0e47f-91ad-4507-96ae-f4dfed9e0817 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:03:59.339695 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-88b0e47f-91ad-4507-96ae-f4dfed9e0817 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:03:59.421384 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-88b0e47f-91ad-4507-96ae-f4dfed9e0817 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lazy-loading 'services' on Instance uuid 886fca83-d514-4f93-b32f-1266cd2f7dde {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:03:59.638994 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-88b0e47f-91ad-4507-96ae-f4dfed9e0817 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "DELETE /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments/586ef244-577f-4e04-a06e-2134ae88f847" status: 202 len: 0 microversion: 2.1 time: 0.313007 Aug 24 06:03:59.639561 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 656/1358] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 06:03:59 2022] DELETE /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments/586ef244-577f-4e04-a06e-2134ae88f847 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:04:01.812837 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-b41ded52-ea5c-494b-b619-d11931f03302 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:01.813331 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-b41ded52-ea5c-494b-b619-d11931f03302 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:01.819709 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b41ded52-ea5c-494b-b619-d11931f03302 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:01.820191 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b41ded52-ea5c-494b-b619-d11931f03302 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:01.820660 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b41ded52-ea5c-494b-b619-d11931f03302 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:01.821354 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b41ded52-ea5c-494b-b619-d11931f03302 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:01.821809 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b41ded52-ea5c-494b-b619-d11931f03302 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:01.822234 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-b41ded52-ea5c-494b-b619-d11931f03302 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:01.854706 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-b41ded52-ea5c-494b-b619-d11931f03302 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments/920d395b-d62a-408d-bdf2-f2305ac4a8c4" status: 200 len: 194 microversion: 2.1 time: 0.045934 Aug 24 06:04:01.855288 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 703/1359] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 24 06:04:01 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments/920d395b-d62a-408d-bdf2-f2305ac4a8c4 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:04:01.867790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-536f2d7c-7463-4b5f-b846-72748408fcc4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:01.868377 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-536f2d7c-7463-4b5f-b846-72748408fcc4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:01.875500 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-536f2d7c-7463-4b5f-b846-72748408fcc4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:01.876000 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-536f2d7c-7463-4b5f-b846-72748408fcc4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:01.876420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-536f2d7c-7463-4b5f-b846-72748408fcc4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:01.877139 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-536f2d7c-7463-4b5f-b846-72748408fcc4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:01.877793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-536f2d7c-7463-4b5f-b846-72748408fcc4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:01.878217 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-536f2d7c-7463-4b5f-b846-72748408fcc4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:01.957974 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-536f2d7c-7463-4b5f-b846-72748408fcc4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lazy-loading 'services' on Instance uuid 886fca83-d514-4f93-b32f-1266cd2f7dde {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:04:02.233074 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-536f2d7c-7463-4b5f-b846-72748408fcc4 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "DELETE /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments/920d395b-d62a-408d-bdf2-f2305ac4a8c4" status: 202 len: 0 microversion: 2.1 time: 0.369950 Aug 24 06:04:02.236995 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 657/1360] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 24 06:04:01 2022] DELETE /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments/920d395b-d62a-408d-bdf2-f2305ac4a8c4 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:04:03.399911 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-c743ee1a-757e-4652-b0ca-d8dcd880c9a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:03.402344 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-c743ee1a-757e-4652-b0ca-d8dcd880c9a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:03.409952 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c743ee1a-757e-4652-b0ca-d8dcd880c9a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:03.416553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c743ee1a-757e-4652-b0ca-d8dcd880c9a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:03.416553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c743ee1a-757e-4652-b0ca-d8dcd880c9a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:03.416553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c743ee1a-757e-4652-b0ca-d8dcd880c9a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:03.416553 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c743ee1a-757e-4652-b0ca-d8dcd880c9a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:03.417005 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-c743ee1a-757e-4652-b0ca-d8dcd880c9a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:03.442508 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-c743ee1a-757e-4652-b0ca-d8dcd880c9a5 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046590 Aug 24 06:04:03.442995 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 704/1361] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 06:04:03 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:04:03.557599 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9bd1bd39-6c04-4eaa-a1e2-9cb67aa3d1cc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:03.559905 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9bd1bd39-6c04-4eaa-a1e2-9cb67aa3d1cc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:03.566911 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bd1bd39-6c04-4eaa-a1e2-9cb67aa3d1cc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:03.567391 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bd1bd39-6c04-4eaa-a1e2-9cb67aa3d1cc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:03.567828 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bd1bd39-6c04-4eaa-a1e2-9cb67aa3d1cc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:03.568555 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bd1bd39-6c04-4eaa-a1e2-9cb67aa3d1cc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:03.569012 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bd1bd39-6c04-4eaa-a1e2-9cb67aa3d1cc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:03.569439 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9bd1bd39-6c04-4eaa-a1e2-9cb67aa3d1cc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:03.597856 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9bd1bd39-6c04-4eaa-a1e2-9cb67aa3d1cc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045385 Aug 24 06:04:03.598401 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 658/1362] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 24 06:04:03 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 06:04:03.658791 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4462cd1f-5702-45a0-8638-752323290120 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:03.659292 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4462cd1f-5702-45a0-8638-752323290120 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:03.665157 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4462cd1f-5702-45a0-8638-752323290120 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:03.665635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4462cd1f-5702-45a0-8638-752323290120 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:03.666065 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4462cd1f-5702-45a0-8638-752323290120 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:03.666749 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4462cd1f-5702-45a0-8638-752323290120 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:03.667197 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4462cd1f-5702-45a0-8638-752323290120 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:03.667617 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4462cd1f-5702-45a0-8638-752323290120 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:03.692475 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4462cd1f-5702-45a0-8638-752323290120 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Going to try to terminate instance {{(pid=127756) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:04:04.005674 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4462cd1f-5702-45a0-8638-752323290120 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "DELETE /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 204 len: 0 microversion: 2.1 time: 0.350450 Aug 24 06:04:04.006264 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 705/1363] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 06:04:03 2022] DELETE /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:04:04.014492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-f24e2f9d-126c-480b-9ad6-3fe87f875afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:04.015177 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-f24e2f9d-126c-480b-9ad6-3fe87f875afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:04.021381 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f24e2f9d-126c-480b-9ad6-3fe87f875afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:04.021858 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f24e2f9d-126c-480b-9ad6-3fe87f875afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:04.022296 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f24e2f9d-126c-480b-9ad6-3fe87f875afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:04.022978 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f24e2f9d-126c-480b-9ad6-3fe87f875afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:04.023427 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f24e2f9d-126c-480b-9ad6-3fe87f875afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:04.023847 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-f24e2f9d-126c-480b-9ad6-3fe87f875afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:04.153782 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-f24e2f9d-126c-480b-9ad6-3fe87f875afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:04:04.162090 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-f24e2f9d-126c-480b-9ad6-3fe87f875afb tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1675 microversion: 2.1 time: 0.151553 Aug 24 06:04:04.162646 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 659/1364] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:04:04 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:04:05.183991 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-3ddc31ba-849a-4a76-bbac-a6d754e63b7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:05.184743 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-3ddc31ba-849a-4a76-bbac-a6d754e63b7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:05.191647 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ddc31ba-849a-4a76-bbac-a6d754e63b7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:05.192128 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ddc31ba-849a-4a76-bbac-a6d754e63b7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:05.192596 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ddc31ba-849a-4a76-bbac-a6d754e63b7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:05.193285 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ddc31ba-849a-4a76-bbac-a6d754e63b7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:05.193739 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ddc31ba-849a-4a76-bbac-a6d754e63b7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:05.194161 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-3ddc31ba-849a-4a76-bbac-a6d754e63b7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:05.322704 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-3ddc31ba-849a-4a76-bbac-a6d754e63b7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:04:05.330731 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-3ddc31ba-849a-4a76-bbac-a6d754e63b7b tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1675 microversion: 2.1 time: 0.151055 Aug 24 06:04:05.331297 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 706/1365] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:04:05 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:04:06.351137 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b6ee2f94-6294-4f38-bb0b-c5914ee70e12 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:06.351776 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-b6ee2f94-6294-4f38-bb0b-c5914ee70e12 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:06.358460 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b6ee2f94-6294-4f38-bb0b-c5914ee70e12 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:06.358974 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b6ee2f94-6294-4f38-bb0b-c5914ee70e12 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:06.359741 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b6ee2f94-6294-4f38-bb0b-c5914ee70e12 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:06.360481 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b6ee2f94-6294-4f38-bb0b-c5914ee70e12 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:06.360949 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b6ee2f94-6294-4f38-bb0b-c5914ee70e12 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:06.361383 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-b6ee2f94-6294-4f38-bb0b-c5914ee70e12 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:06.582487 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-b6ee2f94-6294-4f38-bb0b-c5914ee70e12 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:04:06.590460 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b6ee2f94-6294-4f38-bb0b-c5914ee70e12 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1675 microversion: 2.1 time: 0.243166 Aug 24 06:04:06.591028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 660/1366] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:04:06 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:04:07.256278 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-8b8a3897-db25-4e6b-9e9d-3befcb8be871 req-c574e64a-09d1-4f6f-804f-6fb0aa6c59c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886fca83-d514-4f93-b32f-1266cd2f7dde", "name": "network-vif-deleted", "tag": "beedb010-bdab-47bb-9bec-963fffe3b3d1"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:04:07.266025 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-8b8a3897-db25-4e6b-9e9d-3befcb8be871 req-c574e64a-09d1-4f6f-804f-6fb0aa6c59c7 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:07.298188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-8b8a3897-db25-4e6b-9e9d-3befcb8be871 req-c574e64a-09d1-4f6f-804f-6fb0aa6c59c7 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:07.298188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-8b8a3897-db25-4e6b-9e9d-3befcb8be871 req-c574e64a-09d1-4f6f-804f-6fb0aa6c59c7 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:07.298188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-8b8a3897-db25-4e6b-9e9d-3befcb8be871 req-c574e64a-09d1-4f6f-804f-6fb0aa6c59c7 service nova] Creating event network-vif-deleted:beedb010-bdab-47bb-9bec-963fffe3b3d1 for instance 886fca83-d514-4f93-b32f-1266cd2f7dde on hv-cinder-85426 Aug 24 06:04:07.298188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-8b8a3897-db25-4e6b-9e9d-3befcb8be871 req-c574e64a-09d1-4f6f-804f-6fb0aa6c59c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031362 Aug 24 06:04:07.298188 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 707/1367] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:04:07.612501 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:07.613076 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:07.620512 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:07.621011 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:07.621458 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:07.622161 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:07.622810 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:07.623420 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:07.657232 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:07.657726 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:07.658171 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:07.658738 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lazy-loading 'fault' on Instance uuid 886fca83-d514-4f93-b32f-1266cd2f7dde {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:04:07.704109 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340c99a3e19343aab956056060a23896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4a461b2a2645908c8229d77e13c743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:04:07.713100 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9cccbe28-91ae-4439-9848-c8f8af393708 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 200 len: 1327 microversion: 2.1 time: 0.105833 Aug 24 06:04:07.713663 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 661/1368] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:04:07 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:04:08.737736 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:08.738384 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:08.745004 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:08.745483 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:08.745921 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:08.746606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:08.747061 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:08.747487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:08.761036 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] HTTP exception thrown: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Request method failure captured: Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde HTTP/1.1 Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbzpiLCaG6LtwRj4xLuY9qA1cQs4iXZwNvcXqrLACb82G9mFg5wabUqM0QjQR0S0Jg-SI9XOK4cw2SQyw8Ha7cbpgjz32nJCqye12YsWRCVnS70bYJH2NRFPnFbDSKLuJOB6q9S3dRQRbufpon65FtTTS3i4r7Ean7I7gDzmt3W1ZZ0 Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 06:04:08.762649 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}] Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 340c99a3e19343aab956056060a23896 Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:08.764604 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '886fca83-d514-4f93-b32f-1266cd2f7dde'} Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:04:08.766428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:08.768136 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:08.769744 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Returning 404 to user: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:04:08.769744 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a055041a-29e3-419a-b569-50d359bfe1ca tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 404 len: 111 microversion: 2.1 time: 0.031109 Aug 24 06:04:08.769744 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 708/1369] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:04:08 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:04:08.773741 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-07132d9a-fdd3-4cfd-b609-226b0cd375cc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '.version_select at 0x7f064fddaf70>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:08.908807 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-07132d9a-fdd3-4cfd-b609-226b0cd375cc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-661726036" status: 202 len: 0 microversion: 2.1 time: 0.138813 Aug 24 06:04:08.909398 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 662/1370] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 24 06:04:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-661726036 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:04:12.764130 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:12.764682 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:12.771899 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:12.773385 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:12.773385 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:12.773606 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:12.773942 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:12.774363 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:12.788008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] HTTP exception thrown: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Request method failure captured: Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: DELETE /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde HTTP/1.1 Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbzpiLCaG6LtwRj4xLuY9qA1cQs4iXZwNvcXqrLACb82G9mFg5wabUqM0QjQR0S0Jg-SI9XOK4cw2SQyw8Ha7cbpgjz32nJCqye12YsWRCVnS70bYJH2NRFPnFbDSKLuJOB6q9S3dRQRbufpon65FtTTS3i4r7Ean7I7gDzmt3W1ZZ0 Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 06:04:12.789620 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}] Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 340c99a3e19343aab956056060a23896 Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:12.791496 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '886fca83-d514-4f93-b32f-1266cd2f7dde'} Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:04:12.792760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:12.794537 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:12.796202 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Returning 404 to user: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:04:12.796202 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5c408080-8c47-4c90-8152-2a680ed173a8 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "DELETE /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 404 len: 111 microversion: 2.1 time: 0.030623 Aug 24 06:04:12.796202 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 709/1371] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 06:04:12 2022] DELETE /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:04:12.800010 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:12.800711 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 886fca83-d514-4f93-b32f-1266cd2f7dde] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:12.807805 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:12.808295 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:12.808770 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:12.809465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:12.809946 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:12.810375 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:12.823320 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] HTTP exception thrown: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Request method failure captured: Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde HTTP/1.1 Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbzpiLCaG6LtwRj4xLuY9qA1cQs4iXZwNvcXqrLACb82G9mFg5wabUqM0QjQR0S0Jg-SI9XOK4cw2SQyw8Ha7cbpgjz32nJCqye12YsWRCVnS70bYJH2NRFPnFbDSKLuJOB6q9S3dRQRbufpon65FtTTS3i4r7Ean7I7gDzmt3W1ZZ0 Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 06:04:12.824993 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}] Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: 340c99a3e19343aab956056060a23896 Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:12.826853 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '886fca83-d514-4f93-b32f-1266cd2f7dde'} Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:04:12.828015 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. Aug 24 06:04:12.829823 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:04:12.831293 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Returning 404 to user: Instance 886fca83-d514-4f93-b32f-1266cd2f7dde could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:04:12.831293 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d30e44ac-fee2-44ec-906e-d96b4e9e2138 tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde" status: 404 len: 111 microversion: 2.1 time: 0.030971 Aug 24 06:04:12.831293 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 663/1372] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:04:12 2022] GET /compute/v2.1/servers/886fca83-d514-4f93-b32f-1266cd2f7dde => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:04:14.135888 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:14.136387 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:14.143008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:14.143490 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:14.143927 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:14.144647 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:14.145102 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:14.146052 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:14.159393 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] HTTP exception thrown: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Request method failure captured: Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: DELETE /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 HTTP/1.1 Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBbzpiLCaG6LtwRj4xLuY9qA1cQs4iXZwNvcXqrLACb82G9mFg5wabUqM0QjQR0S0Jg-SI9XOK4cw2SQyw8Ha7cbpgjz32nJCqye12YsWRCVnS70bYJH2NRFPnFbDSKLuJOB6q9S3dRQRbufpon65FtTTS3i4r7Ean7I7gDzmt3W1ZZ0 Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 06:04:14.160957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}] Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 340c99a3e19343aab956056060a23896 Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:04:14.163389 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '21cccbf8-b418-4977-900d-f4b1fa91d277'} Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:04:14.164582 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:04:14.166245 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:04:14.167979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Returning 404 to user: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:04:14.167979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-311a29ae-9d9b-42d8-b217-573159cfd2dc tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "DELETE /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 404 len: 111 microversion: 2.1 time: 0.031172 Aug 24 06:04:14.167979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 710/1373] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 06:04:14 2022] DELETE /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:04:14.171609 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:04:14.172216 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] [instance: 21cccbf8-b418-4977-900d-f4b1fa91d277] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:04:14.179255 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:14.179694 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:14.180126 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:14.182502 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:04:14.182502 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:04:14.182502 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:04:14.197276 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.wsgi [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] HTTP exception thrown: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Request method failure captured: Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: request: GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 HTTP/1.1 Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept: application/json Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Accept-Encoding: identity Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Connection: close Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Length: 0 Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Content-Type: application/json Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Host: 10.222.0.15 Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Openstack-System-Scope: None Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: User-Agent: python-urllib3/1.26.11 Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Auth-Token: gAAAAABjBbzpiLCaG6LtwRj4xLuY9qA1cQs4iXZwNvcXqrLACb82G9mFg5wabUqM0QjQR0S0Jg-SI9XOK4cw2SQyw8Ha7cbpgjz32nJCqye12YsWRCVnS70bYJH2NRFPnFbDSKLuJOB6q9S3dRQRbufpon65FtTTS3i4r7Ean7I7gDzmt3W1ZZ0 Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Id: None Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Domain-Name: None Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Identity-Status: Confirmed Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Is-Admin-Project: True Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Id: default Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Domain-Name: Default Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Project-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Role: reader,member Aug 24 06:04:14.198925 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Roles: reader,member Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dd4a461b2a2645908c8229d77e13c743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dd4a461b2a2645908c8229d77e13c743"}]}] Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Id: dd4a461b2a2645908c8229d77e13c743 Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-Tenant-Name: tempest-AttachVolumeTestJSON-641590877 Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Id: default Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Domain-Name: Default Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Id: 340c99a3e19343aab956056060a23896 Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: X-User-Name: tempest-AttachVolumeTestJSON-641590877-project Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: method: > Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: exception: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:04:14.200477 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: action_args: {'id': '21cccbf8-b418-4977-900d-f4b1fa91d277'} Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:04:14.201403 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. Aug 24 06:04:14.203049 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: ERROR nova.api.openstack.wsgi Aug 24 06:04:14.204732 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] Returning 404 to user: Instance 21cccbf8-b418-4977-900d-f4b1fa91d277 could not be found. {{(pid=127755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:04:14.204732 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-610dd547-481b-4867-b7d5-b1b0c2f749ad tempest-AttachVolumeTestJSON-641590877 tempest-AttachVolumeTestJSON-641590877-project] 10.222.0.15 "GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277" status: 404 len: 111 microversion: 2.1 time: 0.032566 Aug 24 06:04:14.204732 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 664/1374] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:04:14 2022] GET /compute/v2.1/servers/21cccbf8-b418-4977-900d-f4b1fa91d277 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:04:37.415014 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:04:37.415618 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Wed Aug 24 06:04:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:04:42.007852 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:04:42.008471 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Wed Aug 24 06:04:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:04:44.390951 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:04:44.391451 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Wed Aug 24 06:04:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:05:01.000679 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-492da493-7654-4430-891b-81503930f241 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:05:01.001257 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-492da493-7654-4430-891b-81503930f241 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:01.003349 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:05:01.004637 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:05:01.013392 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-492da493-7654-4430-891b-81503930f241 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:01.013698 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-492da493-7654-4430-891b-81503930f241 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:01.014132 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-492da493-7654-4430-891b-81503930f241 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:01.014864 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-492da493-7654-4430-891b-81503930f241 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:01.015328 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-492da493-7654-4430-891b-81503930f241 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:01.016048 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-492da493-7654-4430-891b-81503930f241 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:01.044283 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.objects.instance [None req-492da493-7654-4430-891b-81503930f241 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lazy-loading 'flavor' on Instance uuid 30dc7c37-52f8-435a-a1ed-e6636d1d8efe {{(pid=127756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:05:01.477744 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-492da493-7654-4430-891b-81503930f241 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "POST /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe/action" status: 202 len: 0 microversion: 2.1 time: 0.481247 Aug 24 06:05:01.478487 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 711/1375] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 06:05:00 2022] POST /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:05:01.488096 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-3e698e37-053e-4a4b-85a3-13b6f7a9266b tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:01.488744 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-3e698e37-053e-4a4b-85a3-13b6f7a9266b tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:01.490788 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:05:01.491465 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:05:01.499118 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3e698e37-053e-4a4b-85a3-13b6f7a9266b tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:01.499677 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3e698e37-053e-4a4b-85a3-13b6f7a9266b tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:01.500119 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3e698e37-053e-4a4b-85a3-13b6f7a9266b tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:01.500867 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3e698e37-053e-4a4b-85a3-13b6f7a9266b tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:01.501333 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3e698e37-053e-4a4b-85a3-13b6f7a9266b tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:01.501768 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-3e698e37-053e-4a4b-85a3-13b6f7a9266b tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:01.865459 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-3e698e37-053e-4a4b-85a3-13b6f7a9266b tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:01.874030 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-3e698e37-053e-4a4b-85a3-13b6f7a9266b tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.391338 Aug 24 06:05:01.874591 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 665/1376] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:01 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:02.896964 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-db03e0ff-5081-4d1c-bd63-2608b6e40449 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:02.897662 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-db03e0ff-5081-4d1c-bd63-2608b6e40449 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:02.904957 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-db03e0ff-5081-4d1c-bd63-2608b6e40449 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:02.905438 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-db03e0ff-5081-4d1c-bd63-2608b6e40449 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:02.905873 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-db03e0ff-5081-4d1c-bd63-2608b6e40449 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:02.906557 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-db03e0ff-5081-4d1c-bd63-2608b6e40449 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:02.907008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-db03e0ff-5081-4d1c-bd63-2608b6e40449 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:02.907428 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-db03e0ff-5081-4d1c-bd63-2608b6e40449 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:03.102398 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-db03e0ff-5081-4d1c-bd63-2608b6e40449 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:03.110329 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-db03e0ff-5081-4d1c-bd63-2608b6e40449 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.218192 Aug 24 06:05:03.110900 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 712/1377] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:02 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:04.131229 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-696a3d64-9b0f-49d6-a441-7be3ddd317d3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:04.131850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-696a3d64-9b0f-49d6-a441-7be3ddd317d3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:04.138912 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-696a3d64-9b0f-49d6-a441-7be3ddd317d3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:04.139401 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-696a3d64-9b0f-49d6-a441-7be3ddd317d3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:04.139850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-696a3d64-9b0f-49d6-a441-7be3ddd317d3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:04.140578 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-696a3d64-9b0f-49d6-a441-7be3ddd317d3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:04.141039 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-696a3d64-9b0f-49d6-a441-7be3ddd317d3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:04.141468 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-696a3d64-9b0f-49d6-a441-7be3ddd317d3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:04.271703 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-696a3d64-9b0f-49d6-a441-7be3ddd317d3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:04.280426 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-696a3d64-9b0f-49d6-a441-7be3ddd317d3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.153223 Aug 24 06:05:04.280996 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 666/1378] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:04 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:05.303055 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-2e479c32-9a76-4a43-bce2-7999f1b040a0 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:05.303661 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-2e479c32-9a76-4a43-bce2-7999f1b040a0 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:05.310922 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e479c32-9a76-4a43-bce2-7999f1b040a0 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:05.311398 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e479c32-9a76-4a43-bce2-7999f1b040a0 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:05.311827 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e479c32-9a76-4a43-bce2-7999f1b040a0 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:05.312542 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e479c32-9a76-4a43-bce2-7999f1b040a0 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:05.312994 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e479c32-9a76-4a43-bce2-7999f1b040a0 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:05.313416 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-2e479c32-9a76-4a43-bce2-7999f1b040a0 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:05.447146 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-2e479c32-9a76-4a43-bce2-7999f1b040a0 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:05.455021 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-2e479c32-9a76-4a43-bce2-7999f1b040a0 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.158073 Aug 24 06:05:05.455580 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 713/1379] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:05 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:06.476735 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-4dc93009-23e8-43ae-8f8f-9a3638a059f7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:06.477433 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-4dc93009-23e8-43ae-8f8f-9a3638a059f7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:06.484752 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dc93009-23e8-43ae-8f8f-9a3638a059f7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:06.485235 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dc93009-23e8-43ae-8f8f-9a3638a059f7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:06.485673 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dc93009-23e8-43ae-8f8f-9a3638a059f7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:06.486361 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dc93009-23e8-43ae-8f8f-9a3638a059f7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:06.486819 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dc93009-23e8-43ae-8f8f-9a3638a059f7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:06.487246 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-4dc93009-23e8-43ae-8f8f-9a3638a059f7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:06.616246 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-4dc93009-23e8-43ae-8f8f-9a3638a059f7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:06.625056 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-4dc93009-23e8-43ae-8f8f-9a3638a059f7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.152393 Aug 24 06:05:06.625631 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 667/1380] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:06 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:07.646430 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-084a3b0f-5c52-473e-b798-6376bae21bd7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:07.647042 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-084a3b0f-5c52-473e-b798-6376bae21bd7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:07.653507 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-084a3b0f-5c52-473e-b798-6376bae21bd7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:07.653988 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-084a3b0f-5c52-473e-b798-6376bae21bd7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:07.654426 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-084a3b0f-5c52-473e-b798-6376bae21bd7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:07.655242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-084a3b0f-5c52-473e-b798-6376bae21bd7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:07.655642 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-084a3b0f-5c52-473e-b798-6376bae21bd7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:07.656067 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-084a3b0f-5c52-473e-b798-6376bae21bd7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:07.786118 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-084a3b0f-5c52-473e-b798-6376bae21bd7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:07.793831 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-084a3b0f-5c52-473e-b798-6376bae21bd7 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.151338 Aug 24 06:05:07.794396 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 714/1381] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:07 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:08.815208 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-7ec1a81e-4272-483c-bda8-89171b9fa857 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:08.815818 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-7ec1a81e-4272-483c-bda8-89171b9fa857 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:08.822205 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ec1a81e-4272-483c-bda8-89171b9fa857 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:08.822681 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ec1a81e-4272-483c-bda8-89171b9fa857 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:08.823114 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ec1a81e-4272-483c-bda8-89171b9fa857 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:08.823790 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ec1a81e-4272-483c-bda8-89171b9fa857 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:08.824239 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ec1a81e-4272-483c-bda8-89171b9fa857 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:08.824701 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-7ec1a81e-4272-483c-bda8-89171b9fa857 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:08.954090 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-7ec1a81e-4272-483c-bda8-89171b9fa857 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:08.961718 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-7ec1a81e-4272-483c-bda8-89171b9fa857 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.150445 Aug 24 06:05:08.962279 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 668/1382] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:08 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:09.983250 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-6593963e-80d5-44bd-8a55-7c0ecfd95b4d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:09.983862 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-6593963e-80d5-44bd-8a55-7c0ecfd95b4d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:09.990981 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6593963e-80d5-44bd-8a55-7c0ecfd95b4d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:09.991463 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6593963e-80d5-44bd-8a55-7c0ecfd95b4d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:09.991909 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6593963e-80d5-44bd-8a55-7c0ecfd95b4d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:09.992653 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6593963e-80d5-44bd-8a55-7c0ecfd95b4d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:09.993114 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6593963e-80d5-44bd-8a55-7c0ecfd95b4d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:09.993540 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-6593963e-80d5-44bd-8a55-7c0ecfd95b4d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:10.125053 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-6593963e-80d5-44bd-8a55-7c0ecfd95b4d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:10.132834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-6593963e-80d5-44bd-8a55-7c0ecfd95b4d tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.153562 Aug 24 06:05:10.133403 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 715/1383] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:09 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:11.154775 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-1e4534df-f79e-49a8-b8b6-55b1d7c76331 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:11.155410 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-1e4534df-f79e-49a8-b8b6-55b1d7c76331 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:11.161871 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e4534df-f79e-49a8-b8b6-55b1d7c76331 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:11.165905 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e4534df-f79e-49a8-b8b6-55b1d7c76331 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:11.165905 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e4534df-f79e-49a8-b8b6-55b1d7c76331 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:11.165905 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e4534df-f79e-49a8-b8b6-55b1d7c76331 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:11.165905 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e4534df-f79e-49a8-b8b6-55b1d7c76331 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:11.166303 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-1e4534df-f79e-49a8-b8b6-55b1d7c76331 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:11.305506 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-1e4534df-f79e-49a8-b8b6-55b1d7c76331 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:11.313592 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-1e4534df-f79e-49a8-b8b6-55b1d7c76331 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.162713 Aug 24 06:05:11.314934 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 669/1384] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:11 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:05:12.335116 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-0331bb43-c51b-4ecb-aca8-d7f6221a1c9a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:12.335724 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-0331bb43-c51b-4ecb-aca8-d7f6221a1c9a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:12.342279 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0331bb43-c51b-4ecb-aca8-d7f6221a1c9a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:12.342698 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0331bb43-c51b-4ecb-aca8-d7f6221a1c9a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:12.343133 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0331bb43-c51b-4ecb-aca8-d7f6221a1c9a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:12.343816 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0331bb43-c51b-4ecb-aca8-d7f6221a1c9a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:12.344563 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0331bb43-c51b-4ecb-aca8-d7f6221a1c9a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:12.344992 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-0331bb43-c51b-4ecb-aca8-d7f6221a1c9a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:12.473088 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-0331bb43-c51b-4ecb-aca8-d7f6221a1c9a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:12.480834 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-0331bb43-c51b-4ecb-aca8-d7f6221a1c9a tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.149572 Aug 24 06:05:12.481398 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 716/1385] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:12 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:13.502475 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e9c9ec09-c1f1-48ca-a791-2111287c26c3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:13.503089 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e9c9ec09-c1f1-48ca-a791-2111287c26c3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:13.509704 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e9c9ec09-c1f1-48ca-a791-2111287c26c3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:13.510193 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e9c9ec09-c1f1-48ca-a791-2111287c26c3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:13.510637 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e9c9ec09-c1f1-48ca-a791-2111287c26c3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:13.511333 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e9c9ec09-c1f1-48ca-a791-2111287c26c3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:13.511793 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e9c9ec09-c1f1-48ca-a791-2111287c26c3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:13.512223 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e9c9ec09-c1f1-48ca-a791-2111287c26c3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:13.650773 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e9c9ec09-c1f1-48ca-a791-2111287c26c3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:13.659101 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e9c9ec09-c1f1-48ca-a791-2111287c26c3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.160860 Aug 24 06:05:13.659660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 670/1386] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:13 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:14.680441 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-85146a0f-310d-4564-9c7e-36f16dedf671 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:14.681046 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-85146a0f-310d-4564-9c7e-36f16dedf671 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:14.687621 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-85146a0f-310d-4564-9c7e-36f16dedf671 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:14.688158 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-85146a0f-310d-4564-9c7e-36f16dedf671 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:14.688633 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-85146a0f-310d-4564-9c7e-36f16dedf671 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:14.689369 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-85146a0f-310d-4564-9c7e-36f16dedf671 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:14.689874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-85146a0f-310d-4564-9c7e-36f16dedf671 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:14.690296 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-85146a0f-310d-4564-9c7e-36f16dedf671 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:14.826180 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-85146a0f-310d-4564-9c7e-36f16dedf671 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:14.834488 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-85146a0f-310d-4564-9c7e-36f16dedf671 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.158227 Aug 24 06:05:14.835051 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 717/1387] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:14 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:15.856070 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e6559572-395f-48c4-a79e-cf5332c062de tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:15.856711 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e6559572-395f-48c4-a79e-cf5332c062de tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:15.864295 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e6559572-395f-48c4-a79e-cf5332c062de tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:15.864815 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e6559572-395f-48c4-a79e-cf5332c062de tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:15.865255 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e6559572-395f-48c4-a79e-cf5332c062de tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:15.865953 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e6559572-395f-48c4-a79e-cf5332c062de tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:15.866411 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e6559572-395f-48c4-a79e-cf5332c062de tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:15.866842 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e6559572-395f-48c4-a79e-cf5332c062de tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:15.994928 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e6559572-395f-48c4-a79e-cf5332c062de tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:16.003002 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e6559572-395f-48c4-a79e-cf5332c062de tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1508 microversion: 2.1 time: 0.150852 Aug 24 06:05:16.003581 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 671/1388] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:15 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:16.023419 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9b686f81-1883-4cb9-9e5b-358761daf599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:05:16.024008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9b686f81-1883-4cb9-9e5b-358761daf599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:16.030465 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9b686f81-1883-4cb9-9e5b-358761daf599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:16.036596 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9b686f81-1883-4cb9-9e5b-358761daf599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:16.036596 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9b686f81-1883-4cb9-9e5b-358761daf599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:16.036596 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9b686f81-1883-4cb9-9e5b-358761daf599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:16.036596 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9b686f81-1883-4cb9-9e5b-358761daf599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:16.036990 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9b686f81-1883-4cb9-9e5b-358761daf599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:16.062605 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9b686f81-1883-4cb9-9e5b-358761daf599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127756) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 06:05:16.498603 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9b686f81-1883-4cb9-9e5b-358761daf599 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "POST /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe/action" status: 202 len: 0 microversion: 2.1 time: 0.478794 Aug 24 06:05:16.499139 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 718/1389] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 24 06:05:16 2022] POST /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:05:16.507992 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-d3ac9e00-76b3-4482-9778-413164070de2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:16.508888 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-d3ac9e00-76b3-4482-9778-413164070de2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:16.514527 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d3ac9e00-76b3-4482-9778-413164070de2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:16.515018 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d3ac9e00-76b3-4482-9778-413164070de2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:16.515456 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d3ac9e00-76b3-4482-9778-413164070de2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:16.516986 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d3ac9e00-76b3-4482-9778-413164070de2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:16.517461 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d3ac9e00-76b3-4482-9778-413164070de2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:16.517873 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-d3ac9e00-76b3-4482-9778-413164070de2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:16.655122 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-d3ac9e00-76b3-4482-9778-413164070de2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:16.661383 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-d3ac9e00-76b3-4482-9778-413164070de2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1516 microversion: 2.1 time: 0.157337 Aug 24 06:05:16.661988 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 672/1390] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:16 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:16.771982 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-78c7284c-2a7f-49e5-b793-1fdceffa68ba req-1ba58dcf-aa8b-4b8d-a774-f978ee9dcc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dc7c37-52f8-435a-a1ed-e6636d1d8efe", "name": "network-vif-unplugged", "status": "completed", "tag": "6051ada2-300c-4872-a793-dc5b851ffbfe"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:05:16.782239 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-78c7284c-2a7f-49e5-b793-1fdceffa68ba req-1ba58dcf-aa8b-4b8d-a774-f978ee9dcc20 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:16.782719 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-78c7284c-2a7f-49e5-b793-1fdceffa68ba req-1ba58dcf-aa8b-4b8d-a774-f978ee9dcc20 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:16.783183 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-78c7284c-2a7f-49e5-b793-1fdceffa68ba req-1ba58dcf-aa8b-4b8d-a774-f978ee9dcc20 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:16.794540 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.compute.server_external_events [req-78c7284c-2a7f-49e5-b793-1fdceffa68ba req-1ba58dcf-aa8b-4b8d-a774-f978ee9dcc20 service nova] Unable to find a host for instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe. Dropping event network-vif-unplugged {{(pid=127756) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 06:05:16.795415 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-78c7284c-2a7f-49e5-b793-1fdceffa68ba req-1ba58dcf-aa8b-4b8d-a774-f978ee9dcc20 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028514 Aug 24 06:05:16.796264 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 719/1391] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 06:05:17.683110 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-be365147-8915-4958-8b65-aeedc2be4658 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:17.683765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-be365147-8915-4958-8b65-aeedc2be4658 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:17.690652 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be365147-8915-4958-8b65-aeedc2be4658 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:17.691143 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be365147-8915-4958-8b65-aeedc2be4658 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:17.691585 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be365147-8915-4958-8b65-aeedc2be4658 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:17.692285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be365147-8915-4958-8b65-aeedc2be4658 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:17.692799 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be365147-8915-4958-8b65-aeedc2be4658 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:17.693779 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-be365147-8915-4958-8b65-aeedc2be4658 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:17.840607 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-be365147-8915-4958-8b65-aeedc2be4658 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:17.849508 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-be365147-8915-4958-8b65-aeedc2be4658 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1516 microversion: 2.1 time: 0.170552 Aug 24 06:05:17.850118 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 673/1392] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:17 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:18.872270 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-5796c5ad-f586-4caf-b493-8de28ad09ad8 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:18.872925 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-5796c5ad-f586-4caf-b493-8de28ad09ad8 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:18.881488 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5796c5ad-f586-4caf-b493-8de28ad09ad8 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:18.881640 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5796c5ad-f586-4caf-b493-8de28ad09ad8 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:18.882073 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5796c5ad-f586-4caf-b493-8de28ad09ad8 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:18.882804 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5796c5ad-f586-4caf-b493-8de28ad09ad8 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:18.882804 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5796c5ad-f586-4caf-b493-8de28ad09ad8 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:18.882804 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-5796c5ad-f586-4caf-b493-8de28ad09ad8 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:19.035333 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-5796c5ad-f586-4caf-b493-8de28ad09ad8 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:19.043211 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-5796c5ad-f586-4caf-b493-8de28ad09ad8 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1518 microversion: 2.1 time: 0.175566 Aug 24 06:05:19.043788 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 720/1393] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:18 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:20.067193 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-86d05698-2093-4aba-b8c6-c3dfada8fbe1 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:20.068780 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-86d05698-2093-4aba-b8c6-c3dfada8fbe1 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:20.077443 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86d05698-2093-4aba-b8c6-c3dfada8fbe1 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:20.078308 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86d05698-2093-4aba-b8c6-c3dfada8fbe1 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:20.079009 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86d05698-2093-4aba-b8c6-c3dfada8fbe1 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:20.079785 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86d05698-2093-4aba-b8c6-c3dfada8fbe1 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:20.080639 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86d05698-2093-4aba-b8c6-c3dfada8fbe1 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:20.081734 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-86d05698-2093-4aba-b8c6-c3dfada8fbe1 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:20.220565 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-86d05698-2093-4aba-b8c6-c3dfada8fbe1 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:20.228500 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-86d05698-2093-4aba-b8c6-c3dfada8fbe1 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.167021 Aug 24 06:05:20.229200 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 674/1394] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:20 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:21.249625 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-60069779-a753-4090-8b05-d9b2190fa471 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:21.250289 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-60069779-a753-4090-8b05-d9b2190fa471 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:21.256432 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60069779-a753-4090-8b05-d9b2190fa471 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:21.256933 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60069779-a753-4090-8b05-d9b2190fa471 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:21.257533 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60069779-a753-4090-8b05-d9b2190fa471 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:21.258227 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60069779-a753-4090-8b05-d9b2190fa471 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:21.258795 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60069779-a753-4090-8b05-d9b2190fa471 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:21.259243 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-60069779-a753-4090-8b05-d9b2190fa471 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:21.387006 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-60069779-a753-4090-8b05-d9b2190fa471 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:21.395164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-60069779-a753-4090-8b05-d9b2190fa471 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.149728 Aug 24 06:05:21.395720 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 721/1395] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:21 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:22.416194 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-e0134669-6d88-4e2b-b628-9490bb5cec70 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:22.416784 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-e0134669-6d88-4e2b-b628-9490bb5cec70 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:22.423050 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0134669-6d88-4e2b-b628-9490bb5cec70 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:22.423535 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0134669-6d88-4e2b-b628-9490bb5cec70 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:22.423970 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0134669-6d88-4e2b-b628-9490bb5cec70 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:22.425385 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0134669-6d88-4e2b-b628-9490bb5cec70 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:22.425844 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0134669-6d88-4e2b-b628-9490bb5cec70 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:22.426268 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-e0134669-6d88-4e2b-b628-9490bb5cec70 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:22.557434 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-e0134669-6d88-4e2b-b628-9490bb5cec70 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:22.565273 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-e0134669-6d88-4e2b-b628-9490bb5cec70 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.153017 Aug 24 06:05:22.565929 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 675/1396] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:22 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:23.585502 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-05ea31b1-03df-4a2b-8b9d-5ea7c98ba273 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:23.586092 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-05ea31b1-03df-4a2b-8b9d-5ea7c98ba273 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:23.592689 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ea31b1-03df-4a2b-8b9d-5ea7c98ba273 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:23.593203 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ea31b1-03df-4a2b-8b9d-5ea7c98ba273 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:23.593634 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ea31b1-03df-4a2b-8b9d-5ea7c98ba273 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:23.594307 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ea31b1-03df-4a2b-8b9d-5ea7c98ba273 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:23.594752 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ea31b1-03df-4a2b-8b9d-5ea7c98ba273 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:23.595167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-05ea31b1-03df-4a2b-8b9d-5ea7c98ba273 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:23.726751 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-05ea31b1-03df-4a2b-8b9d-5ea7c98ba273 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:23.734322 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-05ea31b1-03df-4a2b-8b9d-5ea7c98ba273 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.152797 Aug 24 06:05:23.734877 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 722/1397] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:23 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:05:24.755962 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-30569d98-6bec-47f6-b9d8-d7b7db431f74 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:24.756624 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-30569d98-6bec-47f6-b9d8-d7b7db431f74 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:24.763247 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-30569d98-6bec-47f6-b9d8-d7b7db431f74 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:24.763728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-30569d98-6bec-47f6-b9d8-d7b7db431f74 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:24.764165 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-30569d98-6bec-47f6-b9d8-d7b7db431f74 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:24.764892 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-30569d98-6bec-47f6-b9d8-d7b7db431f74 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:24.765367 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-30569d98-6bec-47f6-b9d8-d7b7db431f74 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:24.765778 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-30569d98-6bec-47f6-b9d8-d7b7db431f74 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:24.893096 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-30569d98-6bec-47f6-b9d8-d7b7db431f74 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:24.900850 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-30569d98-6bec-47f6-b9d8-d7b7db431f74 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.149096 Aug 24 06:05:24.901413 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 676/1398] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:24 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:25.922295 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-a177cfed-ee1a-41af-9b63-e601692f43ae tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:25.922904 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-a177cfed-ee1a-41af-9b63-e601692f43ae tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:25.930147 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a177cfed-ee1a-41af-9b63-e601692f43ae tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:25.930626 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a177cfed-ee1a-41af-9b63-e601692f43ae tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:25.931056 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a177cfed-ee1a-41af-9b63-e601692f43ae tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:25.931739 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a177cfed-ee1a-41af-9b63-e601692f43ae tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:25.932189 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a177cfed-ee1a-41af-9b63-e601692f43ae tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:25.932635 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-a177cfed-ee1a-41af-9b63-e601692f43ae tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:26.063644 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-a177cfed-ee1a-41af-9b63-e601692f43ae tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:26.072080 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-a177cfed-ee1a-41af-9b63-e601692f43ae tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.153748 Aug 24 06:05:26.072668 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 723/1399] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:25 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:27.092967 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-ef4a2442-3a27-4be6-9c2a-ddc75f90f1ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:27.093588 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-ef4a2442-3a27-4be6-9c2a-ddc75f90f1ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:27.100729 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef4a2442-3a27-4be6-9c2a-ddc75f90f1ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:27.101219 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef4a2442-3a27-4be6-9c2a-ddc75f90f1ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:27.101656 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef4a2442-3a27-4be6-9c2a-ddc75f90f1ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:27.102383 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef4a2442-3a27-4be6-9c2a-ddc75f90f1ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:27.102840 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef4a2442-3a27-4be6-9c2a-ddc75f90f1ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:27.103267 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-ef4a2442-3a27-4be6-9c2a-ddc75f90f1ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:27.236040 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-ef4a2442-3a27-4be6-9c2a-ddc75f90f1ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:27.245317 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-ef4a2442-3a27-4be6-9c2a-ddc75f90f1ea tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.156227 Aug 24 06:05:27.245898 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 677/1400] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:27 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:28.266532 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-cc848c99-d433-490a-9232-83d91aec2b11 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:28.267145 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-cc848c99-d433-490a-9232-83d91aec2b11 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:28.273793 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cc848c99-d433-490a-9232-83d91aec2b11 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:28.274267 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cc848c99-d433-490a-9232-83d91aec2b11 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:28.274698 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cc848c99-d433-490a-9232-83d91aec2b11 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:28.275378 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cc848c99-d433-490a-9232-83d91aec2b11 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:28.275838 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cc848c99-d433-490a-9232-83d91aec2b11 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:28.276255 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cc848c99-d433-490a-9232-83d91aec2b11 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:28.405459 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cc848c99-d433-490a-9232-83d91aec2b11 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:28.413722 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-cc848c99-d433-490a-9232-83d91aec2b11 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.151059 Aug 24 06:05:28.414280 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 724/1401] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:28 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:29.435028 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-6cc79d50-19f9-4bb0-bfd7-1591c1e15259 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:29.435643 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-6cc79d50-19f9-4bb0-bfd7-1591c1e15259 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:29.442216 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cc79d50-19f9-4bb0-bfd7-1591c1e15259 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:29.442695 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cc79d50-19f9-4bb0-bfd7-1591c1e15259 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:29.443130 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cc79d50-19f9-4bb0-bfd7-1591c1e15259 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:29.443829 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cc79d50-19f9-4bb0-bfd7-1591c1e15259 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:29.444285 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cc79d50-19f9-4bb0-bfd7-1591c1e15259 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:29.444743 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-6cc79d50-19f9-4bb0-bfd7-1591c1e15259 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:29.579026 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-6cc79d50-19f9-4bb0-bfd7-1591c1e15259 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:29.588694 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-6cc79d50-19f9-4bb0-bfd7-1591c1e15259 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.156626 Aug 24 06:05:29.588694 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 678/1402] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:29 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:30.609752 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-cadd28b1-15f4-42c8-89df-616d3ba38a56 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:30.610304 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-cadd28b1-15f4-42c8-89df-616d3ba38a56 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:30.617239 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cadd28b1-15f4-42c8-89df-616d3ba38a56 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:30.617723 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cadd28b1-15f4-42c8-89df-616d3ba38a56 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:30.618164 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cadd28b1-15f4-42c8-89df-616d3ba38a56 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:30.618874 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cadd28b1-15f4-42c8-89df-616d3ba38a56 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:30.619350 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cadd28b1-15f4-42c8-89df-616d3ba38a56 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:30.619776 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-cadd28b1-15f4-42c8-89df-616d3ba38a56 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:30.623800 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:05:30.749909 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-cadd28b1-15f4-42c8-89df-616d3ba38a56 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:30.757900 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-cadd28b1-15f4-42c8-89df-616d3ba38a56 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.152184 Aug 24 06:05:30.758466 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 725/1403] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:30 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:30.874766 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-fde6b5ef-6b76-4069-9139-320ab63532a5 req-e70c9648-5615-497c-a70d-ff6426e5626f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dc7c37-52f8-435a-a1ed-e6636d1d8efe", "name": "network-vif-plugged", "status": "completed", "tag": "6051ada2-300c-4872-a793-dc5b851ffbfe"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:05:30.884581 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-fde6b5ef-6b76-4069-9139-320ab63532a5 req-e70c9648-5615-497c-a70d-ff6426e5626f service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:30.885052 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-fde6b5ef-6b76-4069-9139-320ab63532a5 req-e70c9648-5615-497c-a70d-ff6426e5626f service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:30.885479 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-fde6b5ef-6b76-4069-9139-320ab63532a5 req-e70c9648-5615-497c-a70d-ff6426e5626f service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:30.896359 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-fde6b5ef-6b76-4069-9139-320ab63532a5 req-e70c9648-5615-497c-a70d-ff6426e5626f service nova] Creating event network-vif-plugged:6051ada2-300c-4872-a793-dc5b851ffbfe for instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe on hv-cinder-85426 Aug 24 06:05:30.901435 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-fde6b5ef-6b76-4069-9139-320ab63532a5 req-e70c9648-5615-497c-a70d-ff6426e5626f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030319 Aug 24 06:05:30.905666 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 679/1404] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:05:31.778301 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-4adfa220-ad7f-4324-a37e-92a2eb6b2d92 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:31.778901 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-4adfa220-ad7f-4324-a37e-92a2eb6b2d92 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:31.781217 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:05:31.786290 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4adfa220-ad7f-4324-a37e-92a2eb6b2d92 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:31.786781 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4adfa220-ad7f-4324-a37e-92a2eb6b2d92 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:31.787222 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4adfa220-ad7f-4324-a37e-92a2eb6b2d92 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:31.787912 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4adfa220-ad7f-4324-a37e-92a2eb6b2d92 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:31.788369 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4adfa220-ad7f-4324-a37e-92a2eb6b2d92 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:31.788823 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-4adfa220-ad7f-4324-a37e-92a2eb6b2d92 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:31.922797 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-4adfa220-ad7f-4324-a37e-92a2eb6b2d92 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:31.931254 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-4adfa220-ad7f-4324-a37e-92a2eb6b2d92 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.157212 Aug 24 06:05:31.931811 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 726/1405] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:31 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:32.954334 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-8630ce53-f530-4cca-bd01-a82cf445b0b3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:32.955042 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-8630ce53-f530-4cca-bd01-a82cf445b0b3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:32.957176 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=31 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:05:32.965773 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8630ce53-f530-4cca-bd01-a82cf445b0b3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:32.966657 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8630ce53-f530-4cca-bd01-a82cf445b0b3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:32.967480 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8630ce53-f530-4cca-bd01-a82cf445b0b3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:32.968865 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8630ce53-f530-4cca-bd01-a82cf445b0b3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:32.969415 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8630ce53-f530-4cca-bd01-a82cf445b0b3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:32.969857 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-8630ce53-f530-4cca-bd01-a82cf445b0b3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:32.975511 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_cell1:SELECT=87 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:05:33.119083 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-8630ce53-f530-4cca-bd01-a82cf445b0b3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:33.126858 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-8630ce53-f530-4cca-bd01-a82cf445b0b3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1574 microversion: 2.1 time: 0.177375 Aug 24 06:05:33.134837 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 680/1406] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:32 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:05:34.149547 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-ea1f30f2-8efe-4de2-b82c-5e18f26a2eb3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:05:34.150671 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-ea1f30f2-8efe-4de2-b82c-5e18f26a2eb3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:05:34.159858 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea1f30f2-8efe-4de2-b82c-5e18f26a2eb3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:34.160533 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea1f30f2-8efe-4de2-b82c-5e18f26a2eb3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:34.160979 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea1f30f2-8efe-4de2-b82c-5e18f26a2eb3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:34.161687 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea1f30f2-8efe-4de2-b82c-5e18f26a2eb3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:05:34.162168 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea1f30f2-8efe-4de2-b82c-5e18f26a2eb3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:05:34.162600 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-ea1f30f2-8efe-4de2-b82c-5e18f26a2eb3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:05:34.305820 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-ea1f30f2-8efe-4de2-b82c-5e18f26a2eb3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:05:34.313601 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-ea1f30f2-8efe-4de2-b82c-5e18f26a2eb3 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1561 microversion: 2.1 time: 0.170359 Aug 24 06:05:34.314168 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 727/1407] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:05:34 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:07:13.453864 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG dbcounter [-] [127755] Writing DB stats nova_api:SELECT=1 {{(pid=127755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:07:13.457854 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-9b0674a0-e96c-4dbf-a547-d51b4c93a098 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:07:13.458492 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9b0674a0-e96c-4dbf-a547-d51b4c93a098 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:07:13.459955 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_api:SELECT=3 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:07:13.461447 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG dbcounter [-] [127756] Writing DB stats nova_cell1:SELECT=16 {{(pid=127756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:07:13.464844 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b0674a0-e96c-4dbf-a547-d51b4c93a098 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:13.465330 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b0674a0-e96c-4dbf-a547-d51b4c93a098 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:13.465765 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b0674a0-e96c-4dbf-a547-d51b4c93a098 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:13.466455 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b0674a0-e96c-4dbf-a547-d51b4c93a098 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:13.466904 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b0674a0-e96c-4dbf-a547-d51b4c93a098 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:13.467322 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-9b0674a0-e96c-4dbf-a547-d51b4c93a098 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:13.493722 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-9b0674a0-e96c-4dbf-a547-d51b4c93a098 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Going to try to terminate instance {{(pid=127755) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:07:13.526715 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [req-f46b2809-b975-4249-95b4-d89b73fa26c8 req-4c623f94-1356-409d-8fa4-b9bca7d22f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dc7c37-52f8-435a-a1ed-e6636d1d8efe", "tag": "6051ada2-300c-4872-a793-dc5b851ffbfe"}]} {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:07:13.536760 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-f46b2809-b975-4249-95b4-d89b73fa26c8 req-4c623f94-1356-409d-8fa4-b9bca7d22f3a service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:13.537242 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-f46b2809-b975-4249-95b4-d89b73fa26c8 req-4c623f94-1356-409d-8fa4-b9bca7d22f3a service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:13.537677 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [req-f46b2809-b975-4249-95b4-d89b73fa26c8 req-4c623f94-1356-409d-8fa4-b9bca7d22f3a service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:13.549806 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.compute.server_external_events [req-f46b2809-b975-4249-95b4-d89b73fa26c8 req-4c623f94-1356-409d-8fa4-b9bca7d22f3a service nova] Creating event network-changed:6051ada2-300c-4872-a793-dc5b851ffbfe for instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe on hv-cinder-85426 Aug 24 06:07:13.555803 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [req-f46b2809-b975-4249-95b4-d89b73fa26c8 req-4c623f94-1356-409d-8fa4-b9bca7d22f3a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107121 Aug 24 06:07:13.556417 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 728/1408] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:07:13.945583 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-9b0674a0-e96c-4dbf-a547-d51b4c93a098 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "DELETE /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 204 len: 0 microversion: 2.1 time: 0.499036 Aug 24 06:07:13.946915 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 681/1409] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 24 06:07:13 2022] DELETE /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:07:13.955251 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-9eef1dd4-a5ad-4d35-8e50-f8437316f35c tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:07:13.955946 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-9eef1dd4-a5ad-4d35-8e50-f8437316f35c tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:07:13.963011 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eef1dd4-a5ad-4d35-8e50-f8437316f35c tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:13.963493 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eef1dd4-a5ad-4d35-8e50-f8437316f35c tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:13.963926 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eef1dd4-a5ad-4d35-8e50-f8437316f35c tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:13.964643 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eef1dd4-a5ad-4d35-8e50-f8437316f35c tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:13.965092 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eef1dd4-a5ad-4d35-8e50-f8437316f35c tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:13.965507 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-9eef1dd4-a5ad-4d35-8e50-f8437316f35c tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:14.103000 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-9eef1dd4-a5ad-4d35-8e50-f8437316f35c tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:07:14.111176 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-9eef1dd4-a5ad-4d35-8e50-f8437316f35c tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.160304 Aug 24 06:07:14.111757 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 729/1410] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:07:13 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:07:15.132762 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-aa404e84-6daf-4288-8407-399ec7f8c817 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:07:15.133469 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-aa404e84-6daf-4288-8407-399ec7f8c817 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:07:15.140472 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa404e84-6daf-4288-8407-399ec7f8c817 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:15.140959 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa404e84-6daf-4288-8407-399ec7f8c817 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:15.141397 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa404e84-6daf-4288-8407-399ec7f8c817 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:15.142117 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa404e84-6daf-4288-8407-399ec7f8c817 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:15.142597 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa404e84-6daf-4288-8407-399ec7f8c817 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:15.143040 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-aa404e84-6daf-4288-8407-399ec7f8c817 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:15.281299 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-aa404e84-6daf-4288-8407-399ec7f8c817 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:07:15.289691 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-aa404e84-6daf-4288-8407-399ec7f8c817 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1567 microversion: 2.1 time: 0.161335 Aug 24 06:07:15.290266 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 682/1411] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:07:15 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:07:16.313178 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-741592d8-94a4-4c87-ae04-e2217f552215 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:07:16.314485 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-741592d8-94a4-4c87-ae04-e2217f552215 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:07:16.322403 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-741592d8-94a4-4c87-ae04-e2217f552215 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:16.322889 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-741592d8-94a4-4c87-ae04-e2217f552215 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:16.323320 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-741592d8-94a4-4c87-ae04-e2217f552215 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:16.324008 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-741592d8-94a4-4c87-ae04-e2217f552215 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:16.324529 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-741592d8-94a4-4c87-ae04-e2217f552215 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:16.324950 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-741592d8-94a4-4c87-ae04-e2217f552215 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:16.371099 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [req-f5a10985-e1e0-41d5-8b9b-1adf120b7776 req-69da6f36-dd3e-40e8-baf7-87c6f9c43878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dc7c37-52f8-435a-a1ed-e6636d1d8efe", "name": "network-vif-deleted", "tag": "6051ada2-300c-4872-a793-dc5b851ffbfe"}]} {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:07:16.382436 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-f5a10985-e1e0-41d5-8b9b-1adf120b7776 req-69da6f36-dd3e-40e8-baf7-87c6f9c43878 service nova] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:16.382959 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-f5a10985-e1e0-41d5-8b9b-1adf120b7776 req-69da6f36-dd3e-40e8-baf7-87c6f9c43878 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:16.383407 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [req-f5a10985-e1e0-41d5-8b9b-1adf120b7776 req-69da6f36-dd3e-40e8-baf7-87c6f9c43878 service nova] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:16.394646 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.compute.server_external_events [req-f5a10985-e1e0-41d5-8b9b-1adf120b7776 req-69da6f36-dd3e-40e8-baf7-87c6f9c43878 service nova] Creating event network-vif-deleted:6051ada2-300c-4872-a793-dc5b851ffbfe for instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe on hv-cinder-85426 Aug 24 06:07:16.398007 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.policy [None req-741592d8-94a4-4c87-ae04-e2217f552215 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:07:16.401137 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [req-f5a10985-e1e0-41d5-8b9b-1adf120b7776 req-69da6f36-dd3e-40e8-baf7-87c6f9c43878 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033494 Aug 24 06:07:16.401784 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 683/1412] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 24 06:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:07:16.406926 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-741592d8-94a4-4c87-ae04-e2217f552215 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1380 microversion: 2.1 time: 0.099338 Aug 24 06:07:16.407471 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 730/1413] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:07:16 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1380 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:07:17.428568 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:07:17.429419 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.compute.api [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127755) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:07:17.435728 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:17.449162 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:17.449162 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:17.449162 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:17.449162 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:17.449600 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:17.468159 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:17.468671 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:17.469113 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG oslo_concurrency.lockutils [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:17.469556 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.objects.instance [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lazy-loading 'fault' on Instance uuid 30dc7c37-52f8-435a-a1ed-e6636d1d8efe {{(pid=127755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:07:17.511241 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.policy [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4870c15b8149908b6c1a99b1f73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7373b9ca241b4fbba12f2413458072bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:07:17.518752 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-fcd898dd-b3fb-4681-ae88-cb774755d623 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 200 len: 1224 microversion: 2.1 time: 0.095126 Aug 24 06:07:17.519312 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 684/1414] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:07:17 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:07:17.712750 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:07:17.712982 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Wed Aug 24 06:07:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:07:18.539254 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '>' {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:07:18.540790 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.compute.api [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] [instance: 30dc7c37-52f8-435a-a1ed-e6636d1d8efe] Fetching instance by UUID {{(pid=127756) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:07:18.547126 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:18.547601 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:18.548034 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:18.548791 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Acquiring lock "b8836218-39fb-4108-99ef-4bb0f27daef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:18.549243 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:18.549665 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG oslo_concurrency.lockutils [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Lock "b8836218-39fb-4108-99ef-4bb0f27daef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:18.563888 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.wsgi [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] HTTP exception thrown: Instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe could not be found. Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Request method failure captured: Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: request: GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe HTTP/1.1 Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept: application/json Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Accept-Encoding: identity Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Connection: close Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Length: 0 Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Content-Type: application/json Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Host: 10.222.0.15 Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Openstack-System-Scope: None Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: User-Agent: python-urllib3/1.26.11 Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Auth-Token: gAAAAABjBb608DaHF397ngdWwQ88CTWnJWYpyOK5KlTOvynZM835vRH3x9yo_8SYGFWSoN9j-U13PEtnmMGWlsaWNeTGm8xsSul_mAYsWzJIuQ6gjjfLrqkJas-4SqOHU-J-5En29sAirDeA3JIOJ_OejDQT-RHTHv96iGJsB4YuoI1fl8a61Kk Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Id: None Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Domain-Name: None Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Identity-Status: Confirmed Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Is-Admin-Project: True Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Id: default Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Domain-Name: Default Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Id: 7373b9ca241b4fbba12f2413458072bb Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Project-Name: tempest-TestShelveInstance-876870335 Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Role: reader,member Aug 24 06:07:18.565879 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Roles: reader,member Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7373b9ca241b4fbba12f2413458072bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7373b9ca241b4fbba12f2413458072bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7373b9ca241b4fbba12f2413458072bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7373b9ca241b4fbba12f2413458072bb"}]}] Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant: tempest-TestShelveInstance-876870335 Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Id: 7373b9ca241b4fbba12f2413458072bb Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-Tenant-Name: tempest-TestShelveInstance-876870335 Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User: tempest-TestShelveInstance-876870335-project Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Id: default Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Domain-Name: Default Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Id: 3b4870c15b8149908b6c1a99b1f73bc0 Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: X-User-Name: tempest-TestShelveInstance-876870335-project Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: method: > Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: exception: Instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe could not be found. Aug 24 06:07:18.567717 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: action_args: {'id': '30dc7c37-52f8-435a-a1ed-e6636d1d8efe'} Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: {{(pid=127756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe could not be found. Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:07:18.568906 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe could not be found. Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe could not be found. Aug 24 06:07:18.570650 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: ERROR nova.api.openstack.wsgi Aug 24 06:07:18.572379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: DEBUG nova.api.openstack.wsgi [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Returning 404 to user: Instance 30dc7c37-52f8-435a-a1ed-e6636d1d8efe could not be found. {{(pid=127756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:07:18.572379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO nova.api.openstack.requestlog [None req-743af6d4-dbfa-4ff7-98dc-059688957992 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe" status: 404 len: 111 microversion: 2.1 time: 0.032015 Aug 24 06:07:18.572379 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: [pid: 127756|app: 0|req: 731/1415] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 24 06:07:18 2022] GET /compute/v2.1/servers/30dc7c37-52f8-435a-a1ed-e6636d1d8efe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:07:18.832040 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: DEBUG nova.api.openstack.wsgi [None req-b03af4c9-9a03-4129-8f57-5547ad9333a2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] Calling method '.version_select at 0x7f06609bb310>' {{(pid=127755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:07:18.957893 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO nova.api.openstack.requestlog [None req-b03af4c9-9a03-4129-8f57-5547ad9333a2 tempest-TestShelveInstance-876870335 tempest-TestShelveInstance-876870335-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2090955796" status: 202 len: 0 microversion: 2.1 time: 0.130972 Aug 24 06:07:18.958660 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: [pid: 127755|app: 0|req: 685/1416] 10.222.0.15 () {58 vars in 1254 bytes} [Wed Aug 24 06:07:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2090955796 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:07:57.424842 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:07:57.425483 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Wed Aug 24 06:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:08:02.016507 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:08:02.017167 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Wed Aug 24 06:08:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:08:04.399506 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:08:04.400024 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Wed Aug 24 06:08:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:09:58.498954 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:09:58.499655 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Wed Aug 24 06:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:10:37.721655 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:10:37.722399 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Wed Aug 24 06:10:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:11:17.434093 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:11:17.434688 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Wed Aug 24 06:11:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:11:22.024703 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:11:22.025375 dv-cinder-854267-1-iscsi devstack@n-api.service[127756]: Wed Aug 24 06:11:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:11:24.407681 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:11:24.408219 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Wed Aug 24 06:11:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:13:18.507167 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:13:18.507942 dv-cinder-854267-1-iscsi devstack@n-api.service[127755]: Wed Aug 24 06:13:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!